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Summary 


The  "Parallel  Vision  Algorithms"  Second  Annual  Technical  Report  covers  the  projea  activities  during  the 
period  from  October  1. 1987  through  December  31,  1988.  The  objective  of  this  project  is  to  develop  and 
implement,  on  hi^y  parallel  computers,  vision  algorithms  that  combine  stereo,  texture,  and  multi¬ 
resolution  techniques  for  determining  local  surface  orientation  and  depth.  Such  algorithms  can  serve  as 
front-end  components  of  autonomous  land  vehicle  vision  systems:'  The  activities  of  the  first  year  of  this 
account  are  reported  in  the  fim  annual  technical  lepOLn  ."Parallel  Vision  Algorithms  -  Annual  Technical 
Report"  (9].'”During  the  second  year  of  the  project,  efforts  have  concentrated  on  the  following:  first, 
implementing  and  testing  on  the  Connection  Machine  the  parallel  programming  environment  that  will  be 
used  to  develop,  implement  and  test  our  parallel  vision  algorithms;  second,  implementing  and  testing 
primitives  for  the  multi-resolution  stereo  and  texture  algorithms  in  this  environment.  Also,  we  condnued 
our  efforts  to  refine  techniques  used  in  our  texture  algorithms,  and  to  develop  a  system  that  integrates 
infonnation  from  several  .shape-firom -texture  methods.  This  report  describes  the  sums  and  progress  of 
these  efforts.  We  describe  first  the  programming  environment  implemenudon,  and  how  to  use  it.  We 
sununarize  the  results  for  multi-resoludon  based  depth  interpoladon  algorithms  on  parallel  architecmres. 
Then,  we  present  algorithms  and  test  results  for  the  texmre  algorithms.  Finally  the  results  of  the  efiorts  of 
integradng  information  ftom  various  shape-from-texmre  algorithms  are  presented. 
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1.  Introduction 

The  objective  of  this  project  is  to  develop  and  implement,  on  highly  parallel  computers, 
integrated  parallel  vision  algorithms  that  combine  stereo,  texture,  and  multi-resolution 
techniques  for  determining  local  surface  orientation  and  depth.  Such  algorithms  are  envisioned 
as  potential  front-end  components  of  autonomous  land  vehicle  vision  systems.  During  the  first 
year  of  the  project,  efforts  concentrated  on  two  fronts;  first,  developing  and  testing  the  parallel 
programming  environment  used  to  develop,  implement,  and  test  our  parallel  vision  algorithms; 
second,  developing  and  testing  multi-resolution  stereo,  and  texture  algorithms.  In  the  second 
year  of  the  projects,  efforts  have  been  concentrated  on  the  implementation  of  the  developed 
algorithms  and  techniques  on  the  Connection  Machine.  Also,  research  has  continued  on  refining 
our  developed  texture  algorithms,  on  implementing  integrated  systems  of  stereo  and  texture  on 
sequential  machines,  and  on  improving  the  ability  to  recognize  surfaces  in  an  image  using  fusion 
of  information  from  more  than  one  surface  recognition  module.  This  report  describes  the 
progress  of  these  efforts  in  the  second  year.  We  describe  first  the  implementation  of  the 
programming  environment  Then,  algorithms  and  test  results  for  multi-resolution  stereo,  and 
texture  algorithms  are  presented.  Progress  in  integrating  the  results  of  different  texture  modules 
is  then  described. 

The  initial  plans  called  for  the  testing  and  implemenution  of  the  parallel  algorithms  on  the  NON- 
VON  Supercomputer  (which  was  being  developed  at  that  time).  With  the  NON-VON  project 
being  terminated,  the  Connection  Machine  was  chosen  as  the  target  machine  to  develop  and  test 
our  algorithms.  An  account  was  obtained  on  CMl  and  CM2  at  Syracuse  University,  and  we 
used  these  machines  to  implement  some  of  the  developed  algorithms. 


2.  Pyramid  Programming  Environment  for  Multi-Resolution  Algorithms 

Hussein  Ibrahim  and  Lisa  Brown 

In  this  chapter,  we  describe  the  pyramid  environment  that  has  been  implemented  on  the 
Connection  Machine  to  program  multi-resoludon  algorithms.  The  mapping  scheme  and  the 
efficient  simulation  of  a  pyramid  architecture  on  the  Connection  Machine  have  been  explained  in 
the  first  annual  report  [9],  and  in  [10].  An  implementation  of  this  environment  on  the 
Connection  Machine  at  Syracuse  Northeast  Parallel  Architectures  Center  (NPAC)  has  been 
carried  out  during  the  second  year  of  the  project.  This  implementation  included  all  the  functions 
required  for  the  mapping  scheme  and  an  implementation  of  the  pyramid  communication 
primitives  and  also  implementation  of  pyramid  loading  and  displaying  functions.  An 
environment  that  combine  all  these  functions  has  been  implemented  and  has  been  used  to 
implement  some  of  the  multi-resolution  algorithms  for  stereo  and  texture.  In  the  following 
sections  a  brief  description  of  the  environment  and  the  functions  used  is  given.  A  user’s  manual 
has  been  written  and  is  attached  to  this  document  [3]. 

2.1  Pyramid  Emulation  on  The  Connection  Machine 

This  section  describes  a  set  of  functions  for  using  image  pyramids  on  the  Connection  Machine. 
These  functions  arc  an  extension  of  *LISP  which  itself  is  an  extension  of  COMMON  LISP.  The 
functions  were  designed  to  work  on  the  Connection  Machine  2  of  the  Northeast  Parallel 
Architectures  Center  located  at  Syracuse  University. 

2.1.1  Description  of  Pyramids 

The  routines  described  herein  can  be  used  to  write  *LISP  programs  for  vision  algorithms  which 
use  multi-resolution  image  pyramids  to  structure  and  manipulate  image  data  [10],  Basically,  by 
using  these  routines,  the  user  can  program  multi-resolution  algorithms  on  the  Connection 
Machine  so  that  inter-pyramid  communications  will  be  executed  efficiently.  Examples  of  typical 
multi-resolution  algorithms  include  the  computation  of  depth  from  stereo  or  motion  and  image 
registration.  Students  here  at  Columbia  University  and  also  at  Syracuse  University  have  used  the 
environment  to  implement  hierarchical  stereo  correlation.  It  is  important  to  note  that  this  system 
deals  with  pyramids  where  each  node  communicates  with  exactly  four  children  below  it,  to  a 
single  parent  above  it,  and  to  four  neighbors  on  the  same  level.  This  system  would  probably  be 
inappropriate  for  emulating  pyramids  with  more  general  configurations. 
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2.12  Naming  Conventions 

The  functions  described  all  use  a  new  data  structure  called  a  pyramid  (or  pmd).  This  structure  is 
actually  composed  of  two  pvars  (parallel  variables  in  *Lisp  language)  although  this  is  transparent 
to  the  user.  All  the  functions  are  written  so  that  in  riMst  cases  those  dealing  with  pyramids  are 
analogous  to  standard  "'lisp  functions  which  deal  with  pvars.  For  example,  to  create  a  pmd  the 
function  is  "'defpmd  (like  "'defvar)  and  ♦sct-pmd  (like  *set).  In  addition,  the  following 
conventions  are  adhered  to  throughout  so  that  properties  of  functions  and  variable  names  are  as 
obvious  as  possible: 

•  [pnod!!]:  All  functions  which  end  with  pmd!!  return  a  pmd. 

•  [♦-pmd]:  All  functions  which  begin  with  an  asterisk  and  end  with  ”pmd”  have 
arguments  which  are  pmds. 

•  [*pmd“*]  All  variables  which  start  with  "*pmd”  and  end  with  an  asterisk  are  global 
pyramid  variables  (see  section  2.1.4  on  global  variables). 

These  conventions  are  similar  to  those  for  pvars  in  *LISP.  We  also  adhere  to  their  conventions; 
namely,  functions  ending  with  !!  return  pvars,  functions  starting  with  asterisks  use  pvars 
internally. 

2.13  Getting  Started 

To  use  the  pyramid  environment  it  is  necessary  that  the  following  two  conditions  are  met: 

1.  The  number  of  logical  processors  should  equal  the  number  of  physical  processors. 

(This  will  be  extended  so  that  the  number  of  logical  processors  can  be  any  multiple 
of  four  times  the  number  of  physical  processors.) 

2.  The  machine  should  be  configured  for  2  dimensions  Hence,  the  number  of 
processors  should  be  of  the  form  2^n  where  n  is  an  integer. 

The  first  condition  can  be  met  by  attaching  to  the  same  number  of  processors  as  you  configure 
the  machine  when  *cold-booting.  The  second  condition  is  met  with  the  :initial-dimensions  to 
♦cold-boot.  To  load  the  pyramid  system,  the  file  “pyramid-emulate"  should  be  loaded  and  the 
function  pjnumid-emulate  is  then  executed.  An  example  session  which  shows  a  start-up  is  shown 
in  the  file  “pmd-example.”  Most  of  the  commands  issued  in  this  session  are  also  contained  in 
the  file,  “pmd-init.lisp”  which  is  the  initialization  file  used  for  testing  the  system. 

2.1.4  Global  Variables 

The  following  are  global  variables  used  by  the  pyramid  system  which  might  also  be  useful  to  the 
user.  A  variable  of  particular  importance  is  *pmd-level-number*. 

•  [*pmd-number-of-levels*]the  number  of  levels  in  the  pyramid. 
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•  [*pind-sizc*l  the  size  of  one  side  of  the  base  of  the  pyramid 

•  [♦pmd-self-address*]  the  address  of  each  processor  in  the  pyramid.  Note:  these 
addresses  indica^*  the  location  of  the  physical  hypercube  connections  that  connect 
the  processors. 

•  [*pmd-level-number*]  a  pvar  which  indicates  the  particular  level  other  than  the 
lowest  level  which  a  processor  represents.  This  pvar  can  be  used  in  a  *when  to 
select  only  the  processors  on  a  certain  level  (above  the  leaf  level). 


2.U  Pyramid  Primitives 

The  following  functions  are  for  creating,  allocating  and  setting  the  values  of  pyramids  and  their 
levels.  They  form  the  basis  of  all  pyramid  programs.  In  addition,  the  *LISP  function  *let  can  be 
used  to  dynamically  create  pmds  using  the  function  allocate-pmd!!. 

(*de£pmd  pmdname  &optional  pmd- initialization) 

(allocata-pmd! ! ) 

(*deallocate-pmd  pmd) 

(*set-pmd  pmd-1  pmd-2) 

(♦set- level -pmd  level  pmd-1  pmd-2) 


2.2  Communications 

In  this  section,  we  describe  functions  to  emulate  pyramid  communication  primitives.  These 
include  horizontal  communications,  communications  between  PE’s  on  the  same  pyramid  level; 
and  vertical  communications  between  PE’s  on  successive  levels  of  the  pyramid. 

2.2.1  Horizontal  Communications 

The  following  functions  execute  mesh  communications  within  individual  levels  of  the  pyramid. 
They  work  according  to  the  scheme  specified  in  [10]. 

(shift-level-pmd! !  level  direction  source-pmd  &optional  dest-pmd 

&]cey  border-pmd) 

This  uses  the  mesh  on  the  specified  level  to  shift  the  data  in  source-pmd  in  the  specified  direction 
(’e  ’w  ’n  or ’s)  and  puts  the  resulting  level  in  the  optionally  specified  dest-pmd  and  returns  it.  For 
example:  (shift-level-pmd!!  1  ’e  pmd-in  pmd-out  :border-pmd  zero-pmd)  shifts  level  1  in  pmd-in 
to  the  east  and  stores  the  result  in  level  1  of  pmd-out  which  is  returned.  The  border-pmd  is  used 
in  the  same  way  the  bonder-pvars  are  used  in  *lisp  commands  such  as  pref-grid!!. 
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(shift -paid! !  diraction  sourca-pad  fioptional 

dast-pod  &kay  bordar-pmd) 

This  is  the  same  as  the  above  function  except  all  levels  are  shifted  and  stored  in  dest-pmd  and 
returned. 

2.2.2  Vertical  Communications 

The  following  functions  execute  top-down  communications  between  levels  of  the  pyramid.  They 
work  according  the  scheme  specified  in  section  4  of  the  article  “On  Implementation  of  Pyramid 
Algorithms  on  the  Connection  Machine"  [10].  Top-down  communications  either  transfer  (and 
combine)  data  &om  one  or  more  children  up  the  pyramid  or  from  a  single  parent  to  one  or  more 
of  its  children.  Children  are  specified  as  'a  'b  ’c  or ’d.  When  communicating  up  the  pyramid  an 
operation  is  specified  which  indicates  how  the  four  children  are  combined  before  setting  the 
parent  value.  The  operation  can  be  any  parallel  operation  such  as  +!!  or  *!!. 

(send-level-parent-pmd! !  level  operation  source-pmd 

&optional  dest-pmd) 

(send-level-children-pmd! !  level  source-pnd  &optional  dest-pmd) 
(send-level-child-pmd! !  level  child  source  (optional  dest-pmd) 
(ave-pmd! !  level  source-pmd  (optional  dest-fmid) 

The  command  ave-pmd! !  is  used  to  make  a  pmd  using  an  image  stored  in  the  lowest  level  and 
making  each  successive  level  above  by  averaging  the  four  children  of  each  parent.  This  is  a 
typical  example  of  a  function  which  uses  the  vertical  communication  functions  to  make  an  image 
pyramid. 

2.3  Pyramid  Input/Output 

These  routines  can  be  used  to  store  a  pyramid  or  pvar  into  a  file  for  use  with  standard  sequential 
image  processing  routines  or  for  reading  such  a  file  into  a  pyramid  or  pvar  for  use  with  this 
system.  Typically  a  pvar  represents  an  image  from  which  a  pyramid  can  be  constructed. 

(read-pvar! !  ''filename''  (optional  pvar) 

(read-pmd! !  ''filename''  (optional  pmd) 

(write-pvar ! !  pvar  '  'filename' ' ) 

(write-pmd! !  pmd  ' 'filename' ' ) 
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23.1  Pyramid  Display 

These  routines  can  be  used  to  print  the  data  sttnvd  in  a  pyramid  either  as  a  single  level  or  the 
entire  pyramid. 

(*display-l«v«l~pmd  pmd  lav«l) 

(*display-Faid  pmd) 

The  *Lisp  code  implementation  of  this  environment  is  included  in  the  Appendix  at  the  end  of 
this  report 
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3.  Depth  Interpolation  Problem  -  A  Multi-Resolution  Approach 

Dong  Jae  Choi,  John  R.  Kender 

Research  in  depth  interpolation  on  fine-grained  Single  Instruction  Stream  Multiple  Data  Stream 
(SIMD)  machines  such  as  NON- VON  or  the  Connection  Machine  has  been  completed  and  has 
resulted  in  a  Ph.D.  thesis  attached  to  this  report  [4].  The  principal  results  of  the  work  are  a 
detailed  comparison  of  five  approaches  to  determining  surface  depth  from  sparse  data,  such  as 
results  from  stereo.  Two  of  the  approaches  are  new,  and  are  provably  optimal.  Extensive 
simulations  written  in  a  way  that  allows  straight  forward  transfer  to  the  Connection  Machine  has 
concluded  that  communication  costs  begin  to  dominate  compute  costs  when  algorithms  are 
optimal.  Additionally,  it  appears  that  pyramid  (multi-resolution)  approaches  to  the  problem 
provide  speedups  of  2  to  2(X)  times  over  conventional  approaches.  These  results  have  been 
submitted  to  a  journal,  and  have  already  appeared  in  several  conferences. 

In  more  detail  the  work  covered  the  following:  many  constraint  propagation  problems  in  early 
vision,  including  depth  interpolation,  can  be  cast  as  solving  a  large  system  of  linear  equations 
where  the  resulting  matrix  is  symmetric  and  positive  definite  (SPD).  Usually,  the  resulting  SPD 
matrix  is  sparse.  The  depth  interpolation  problem  on  a  fine-grained  single  instruction  multiple 
data  (SIMD)  machine  with  local  and  global  communication  networks  has  been  solved.  It  has 
been  shown  how  the  Chebyshev  acceleration  and  the  conjugate  gradient  methods  can  be  run  on 
this  parallel  architecture  for  sparse  SPD  matrices.  Using  an  abstract  SIMD  model,  for  several 
synthetic  and  real  images  it  has  been  shown  that  the  adaptive  Chebyshev  acceleration  method 
executes  faster  that  the  conjugate  gradient  method,  when  given  near  optimal  initial  estimates  of 
the  smallest  and  largest  eigenvalues  of  the  iteration  matrix. 

These  iterative  methods  have  been  extended  through  a  multigrid  approach,  with  a  fixed 
multilevel  coordination  strategy.  It  has  been  shown  again  that  the  adaptive  Chebyshev 
acceleration  method  executes  faster  than  the  conjugate  gradient  method,  when  accelerated 
further  with  the  multigrid  approach.  Furthermore,  it  has  been  shown  that  the  optimal  Chebyshev 
acceleration  method  performs  best  since  this  method  requires  local  computations  only,  whereas 
the  adaptive  Chebyshev  acceleration  and  the  conjugate  gradient  methods  require  both  local  and 
global  computations. 
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4.  Parallel  Texture  Algorithms' 


We  believe,  as  Bajscy  and  Lieberman  contend  in  their  pioneering  work  in  shape  from  texture  [1], 
that  texture  is  the  noost  significant  feature  of  outdoor  scenes.  Shape-from  methods  based  on 
stereo  or  motion  often  have  inherent  difficulty  dealing  with  highly  textured  scenes  since  feature 
matching  becomes  intractable.  On  the  other  hand,  enormous  information  is  available  for  explicit 
surface  reconstruction  where  surfaces  are  textured;  indeed,  many  surfaces  cannot  be 
unambiguously  reconstructed  unless  they  are  textured.  (See  [2]  fur  a  good  example.)  Guidance 
and  recognition  tasks  could  be  greatly  improved  with  the  assistance  of  a  shape- from- texture 
system  if  they  were  able  to  deal  with  a  broad  range  of  natural  textures  without  complex  stmctural 
knowledge  or  extreme  computational  costs. 

In  this  section  of  the  report,  we  will  describe  two  approaches  that  we  have  taken  to  exploit 
textural  cues  for  the  recovery  of  three  dimensional  information.  The  first  approach,  investigated 
by  Lisa  Brown,  is  based  on  our  previously  reported  work  on  the  projective  foreshortening  of 
isotropic  texture  autocorrelation.  During  the  past  year,  this  work  has  been  extended  to 
anisotropic  textures  using  multiple  viewing  and  an  investigation  has  begun  on  exploiting 
integrability  in  reconstructing  a  depth  map  from  surface  orientation  measurements.  The  second 
^proach,  taken  by  M.  Moerdler  and  J.  R.  Render,  entails  integrating  several  shape  from  texture 
algorithms.  This  work  was  based  on  a  system  designed  during  the  first  year  of  the  project  which 
fuses  several  conflicting  and  corroborating  texture  cues  to  derive  surface  orientations.  During 
the  past  year,  this  system  has  been  implemented,  tested  and  simplified  so  that  it  is  now  a  general 
method  for  incorporating  new  texture  modules  as  they  become  available. 


4.1  Surface  Orientation  for  a  Wide  Class  of  Natural  Textures  Using  Texture 
Autocorrelation 


Lisa  Brown 


We  report  on  a  refinement  of  our  technique  for  determining  the  orientation  of  a  textured  surface 
from  the  two- point  autocorrelation  function  of  its  image  [9].  In  our  initial  approach  we  needed 
to  assume  textural  isotropy  which  we  now  replace  with  knowledge  of  the  autocorrelation 
moment  matrix  of  the  texture  when  viewed  head  on.  The  orientation  of  a  textured  surface  can 
then  be  deduced  from  the  effects  of  foreshortening  on  these  autocorrelation  naoments.  We  have 
applied  this  technique  to  natural  images  of  planar  textured  surfaces  and  obtained  significantly 
improved  results  on  anisotropic  textures  which  under  the  assumption  of  isotropy  mimic  the 
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effects  of  projective  foreshortening.  The  resulting  method  is  capable  of  measuring  surface 
orientation  for  a  broader  class  of  naturally  occurring  textures  than  has  been  previously  been 
possible.  We  will  describe  briefly  this  new  technique,  its  implementation  and  results  and  its 
potential  practicality  for  autonomous  navigation. 

In  our  previous  method  and  its  precursor  proposed  by  Witkin  [20],  local  surface  orientation  is 
computed  from  the  effects  of  foreshortening  for  textures  which  are  assumed  to  be  isotropic.  By 
isotropic,  we  mean,  statistically  speaking,  textures  that  have  no  inherent  directionality.  Unlike 
the  majority  of  shape-from-texture  methods,  which  rely  on  a  texture  gradient  caused  by  the 
per^)ective  projection,  these  methods  look  at  how  a  statistical  distribution,  dependent  on  the 
direction  of  textural  components  in  the  image,  is  effected  by  the  foreshortening  due  to 
orthographic  projection.  Witkin  proposed  to  use  a  histogram  of  edge  directions  to  determine 
surface  orientation  via  a  maximum  likelihood  fit,  while  in  our  previous  work,  we  used  the  second 
order  moments  of  the  two-dimensional  two-point  autocorrelation.  The  latter  has  the  advantage  of 
being  simpler  and  more  robust,  broadening  the  range  of  textured  surfaces  whose  orientation 
could  be  determined  because  of  the  use  of  information  ffom  all  parts  of  the  image.  Nevertheless, 
the  assumption  of  isotropy  is  a  very  strong  and  limiting  factor  for  both  of  these  methods. 

The  method  proposed  here  is  an  extension  of  our  earlier  technique  based  on  the  foreshortening  of 
texture  autocorrelation.  In  order  to  analyze  how  surface  orientation  could  be  obtained  for  a 
much  broader  class  of  textures,  a  priori  information  about  each  texture,  specifically  the 
autocorrelation  moment  matrix  of  the  texture  when  viewed  head  on,  is  used.  With  this  additional 
information,  the  original  technique  can  be  extended  to  all  textures  regardless  of  whether  or  not 
they  are  isotropic. 

In  the  original  method,  it  was  possible  to  compute  the  surface  orientation  directly  from  the 
relation  between  the  autocorrelation  moment  matrix  when  viewed  head  on  and  the  current 
estimate,  since  was  known  to  be  a  multiple  of  the  identity  since  the  texture  was  assumed  to  be 
isotropic.  The  slant  and  tilt  could  be  specified  as  simple  functions  of  the  autocorrelation  moment 
matrix.  Without  this  assumption,  further  information  is  necessary  to  resolve  the  orientation.  We 
have  chosen  to  use  the  autocorrelation  moment  matrix  for  the  texture  when  viewed  head-on  as  an 
additional  input.  Given  this  prior  information,  it  is  now  possible  to  compute  the  surface 
orientation  by  an  iterative  solution  using  Newton’s  method. 

To  test  this  method,  a  series  of  images  were  taken  of  three  commonly  found  textures:  brick, 
wood  and  stone.  The  brick  and  wood  were  both  highly  anisotropic  while  the  stone  was 
sufficiently  anisotropic  that  the  original  method  gave  unsatisfactory  results.  In  each  case  a  single 
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planar  surfiice  was  friioiograpiied  finom  a  sufficient  distance  that  orthographic  projection  was  a 
good  approximation,  and  diat  the  entire  inu^  consisted  of  an  image  with  a  single  orientation. 
For  each  texture,  several  photographs  were  taken  of  each  texture  at  varying  surface  orientations 
including  one  winch  was  a  head-on  view.  An  attempt  was  made  to  keep  the  same  location  on  the 
surface  in  the  center  of  each  photograph  and  to  keep  the  camera  at  a  fixed  distance  from  the 
surface.  The  actual  orientations  were  obtained,  as  in  the  previous  study,  using  an  identical 
picture  for  each  orienmtion,  in  which  a  flat  circular  object  was  placed  on  the  surface. 

As  before,  photographs  were  digitized  to  yield  256  x  256  8-bit  gray-scale  images,  and  the 
autocorrelation  was  confuted  as  the  Fourier  transform  of  the  power  spectrum  of  the  image. 
Based  on  our  previous  results,  to  compensate  for  statistical  noise,  the  second  order  moments 
were  summed  only  over  those  autocorrelation  values  which  were  greater  than  the  average  value 
found  in  a  ring  of  radius  10  pixels. 

The  nonlinear  system  of  equations  given  was  solved  using  Newton’s  Method.  This  was  guided 
by  an  initial  estimate  of  the  foreshortening  matrix  determined  from  the  solution  obtained  if  we 
assume  the  surface  is  isotropic  (i.e.  we  let  be  proportional  to  the  identity.)  Convergence  with 
insignificant  computational  cost  occurred  in  all  instances  except  one  in  which  the  autocorrelation 
moment  matrix  was  not  positive  definite,  presumably  due  to  statistical  error.  This  was  confirmed 
by  another  picture  of  the  same  texture  (wood)  whose  orientation  was  similar.  In  this  instance,  the 
matrix  was  marginally  positive  definite,  convergence  was  slower,  but  a  good  estimate  of  the 
orientation  was  found.  Over  the  whole  sample,  the  average  error  in  the  slant  and  tilt  estimates 
was  8  and  4  percent  respectively.  The  worst  errors  were  17  and  10  percent  respectively.  A  5 
percent  error  is  estimated  in  the  measurement  of  the  actual  orientation. 

Examples  of  two  of  the  pictures  and  their  autocorrelation  are  given  in  Figure  4-1.  From  the 
autocorrelations  in  this  figure  you  can  see  that  the  textures  are  anisotropic.  If  the  texture  was 
isotropic  the  autocorrelation  would  be  composed  of  concentric  scaled  elliptic  iso-contours 
(which  are  circular  if  the  surface  is  viewed  head  on.)  For  each  view  of  a  textured  surface 
contained  in  the  figure,  one  picture  depicts  the  surface  with  a  flat  circular  object  laying  upon  it. 
This  makes  the  surface  orientation  explicit  just  as  it  would  for  the  autocorrelation  if  the  texture 
were  isotropic.  Since  the  textures  are  anisotropic,  the  comparable  orientation  information  is 
contained  only  in  the  autocorrelation  relative  to  the  head  on  autocorrelation.  Our  technique 
measures  this  distortion,  due  to  foreshortening,  which  transforms  the  autocorrelation  in  the  same 
way  it  transforms  the  image  under  orthographic  projection. 

In  all  but  the  previously  mentioned  case,  surface  orientation  estimates  were  accurate  even  though 
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in  many  cases  textural  anisotropy  mimicked  the  effects  of  fOTcshortening.  Use  of  prior 
knowledge  of  the  autoctxreladon  moments  from  a  head-on  view  was  chosen  for  simplicity,  but 
any  other  view  would  suffice  as  long  as  its  orientation  was  known.  Since  it  is  not  feasible  to 
have  prior  infumation  about  each  texture,  in  practice  the  next  step  would  be  to  use  muldpie 
views  of  each  texture  in  which  the  orientations  of  all  the  views  are  unknown.  Rom  the  change 
in  autocorrelation  moment  matrices,  leladve  orientations  could  be  computed  which  a  surface 
reconstruction  algorithm  would  uldmately  fit  into  a  coherent  3-D  percepdon  of  the  scene. 

We  have  examined  a  refinement  of  our  technique  for  determining  the  oiientadon  of  a  textured 
surface  from  the  two-point  autocorreladon  funcdon  of  its  image.  The  previous  assumpdon  of 
textural  isotropy  was  replaced  by  knowledge  of  the  autocorreladon  moment  matrix  of  the  texture 
when  viewed  head  on.  The  orientadon  was  then  deduced  from  the  effects  of  the  foreshortening 
on  the  autoconeladon  moments.  The  new  technique  can  successfully  deteimine  surface 
orientadon  for  anisotropic  textures.  This  technique  suggests  an  image  understanding  system 
guided  by  a  texture  classificadon  scheme  would  be  capable  of  determining  surface  orientadon 
for  a  broader  class  of  textures  than  has  been  previously  possible.  The  results  of  this  work  confrrm 
that  powerful  cues  for  3-D  percepdon  can  be  extracted  from  textured  surfaces. 

4.1.1  Constructing  Depth  Map  From  Surface  Orientation  Measures 
In  compledng  our  work  on  shape  from  texture  autocorreladon,  we  have  been  investigating 
techniques  for  reconstructing  a  depth  map  from  surface  orientadon  measurements.  Several 
studies  have  been  conducted  on  recovering  depth  from  sparse  depth  and  orientadon  data 
[8, 18,  S].  However,  because  our  texture  module  is  capable  of  computing  surface  orientations  at 
every  point  in  the  image,  our  problem  is  no  longer  one  of  interpolation.  Instead,  we  are  interested 
in  exploiting  the  integrability  constraint  using  a  simple  Gauss-Seidel  relaxation  in  order  to 
recover  a  depth  map  of  the  original  image.  Our  investigation  began  with  an  error  analysis  of  the 
sensitivity  of  the  depth  map  when  the  orientations  have  multiplicative  Gaussian  noise.  Most 
recently,  our  research  in  this  area  has  been  an  empirical  study  of  enforcing  integrability  on  shape 
from  texture  autocorrelation,  using  real  imagery  of  a  physically  existing  surface  model  whose 
depths  are  known  accurately.  Our  objective  has  been  to  develop  the  first  working  shape-from- 
texture  system  which 

•  computes  21/2  D  depths  (not  just  orientations) 

•  works  for  real  imagery  (not  synthetically  projected  textures) 

•  of  natural  textures  (both  naturally  occurring  and  those  found  in  nature) 

•  and  has  been  tested  against  objective  quantifiable  measures. 

By  accomplishing  this  goal,  this  unit  could  then  directly  serve  as  part  of  a  front-end  for  an 
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auUMKHDOus  land  vehicle  navigation  system. 

Recently,  related  wodk  by  Frankot  Sc,  Chellappa  has  shown  the  merits  of  enforcing  the 
integrability  constraint  for  constructing  consistent  depths  for  shape  from  shading.  Their 
approach  is  to  find  the  orthogonal  projection  onto  the  vector  subspace  spanning  the  set  of 
integrable  slopes  represented  by  a  set  of  basis  functions  using  the  POCS  (projection  of  convex 
sets)  method  which  they  prove  is  appropriate  for  this  domain.  Shading  information  however, 
even  when  coupled  with  information  about  the  light  sources,  is  only  capable  of  indicating  slope 
unless  other  constraints  such  as  smoothness  are  imposed.  Since  the  problem  of  depth 
reconstruction  in  shape  from  shading  is  under  constrained,  integrability  plays  a  different  role 
than  it  does  in  shape  from  texture  where  including  integrability  makes  the  problem  becomes 
over-determined.  Yet,  Frankot  &  Chellapa  show  that  for  a  particular  shape  from  shading 
algorithm  enforcing  integrability  increases  the  speed  of  convergence,  lessens  the  need  for 
regularization  and  improves  accuracy. 

4.U  Experimental  Results 

In  order  to  study  the  sensitivity  of  noise  on  orientations,  when  reconstructing  the  2  1/2  D  depth 
map,  we  looked  at  a  variety  of  synthetic  continuous  differentiable  surfaces.  Our  method  of 
constructing  these  surfaces  was  to  use  the  superposition  of  any  number  of  ’3D  sine  bumps’ 
where  a  sine  bump  was  simply  a  period  of  a  sine  wave  from  -Wl  to  311/2.  This  had  the  nice 
property  that  we  could  construct  a  wide  range  of  surfaces  but  all  the  orientations  are  well-defined 
and  easy  to  compute.  In  all  cases,  we  chose  a  collection  of  sine  bumps  which  composed  a  surface 
with  zero  boundaries  although  it  would  be  interesting  to  test  the  sensitivity  of  the  relaxation  to 
variations  in  this  constraint  as  well. 

We  then  looked  at  how  a  straightforward  Gauss-Seidel  style  relaxation  would  recover  the  depths 
from  the  orientations.  Our  objective  function  corresponded  to  the  least  squares  minimization  (or 
convolution  kemal)  shown  in  Figure  4-2(a).  Notice  the  checkerboard-style  locations  of  the 
orientations  with  respect  to  the  locations  of  the  depths.  This  is  important  in  order  to  avoid  a 
coupling  which  occurs  in  many  other  kemal  choices.  For  example,  consider  the  choice  given  in 
Figure  4-2(b)  where  the  finite  difference  estimate  of  the  orientations  uses  the  four  surrounding 
depths.  In  this  case,  the  central  depths  (marked  with  circles  in  the  figure)  cannot  be  utilized  by 
the  resulting  objective  function  because  their  effects  are  canceled  out.  Because  in  the 
checkerboard  pattern,  orientations  and  depths  have  different  grid  locations  and  we  want  the 
results  at  the  same  locations,  the  orientations  for  the  reconstruction  were  computed  by  averaging 
the  two  neighboring  orientations  for  each  gradient  direction.  It  was  felt  that  the  high  frequency 
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information  that  would  be  lost  in  doing  so  would  be  extremely  minimal  in  the  case  where  texture 
autoconelation  was  used  since  considerable  overl£^  of  the  original  image  would  have  already 
beat  necessary  to  compute  neighboring  orientations. 

Examples  of  two  reconstructed  synthetic  surfaces  studied  are  given  in  Figure  4-3  and  4-4.  In 
Figure  4-3  the  surface  has  been  accurately  reconstructed  from  orientations  with  a  significant 
amount  of  multiplicative  Gaussian  noise  are  shown.  The  method  t^pears  highly  insensitive  to 
noise,  even  when  the  standard  deviation  of  the  multiplicative  Gaussian  noise  is  as  large  as  1.6. 
We  believe  this  is  a  result  of  the  substantial  smoothness  inherent  in  the  synthetic  surface.  In 
Figure  4-4,  since  the  slopes  are  steeper,  the  resolution  of  the  orientations  is  not  high  enough  to 
recover  the  depth  acciuntely.  However,  as  can  be  seen  in  the  figure,  the  reconstructed  surface 
matches  the  true  surface  except  for  a  high  frequency  component.  A  smoothness  constraint  added 
to  the  objective  function  would  probably  be  sufficient  to  correct  for  this  in  cases  where  it  would 
be  possible  to  make  this  assumption. 

It  was  our  original  objective  to  complete  a  working  shape  from  from  texture  system  applicable  to 
real  imagery  of  natural  textures.  We  wanted  to  see  what  the  potentials  and  shortcomings  would 
be  in  the  real  world  of  lens  blurring  and  distortions,  texture  anomolies,  small  surface 
perturbations,  slight  lighting  variations  and  other  uncontrollable  and  unknown  factors.  Lastly,  we 
wanted  to  be  able  to  quantify  our  results  against  an  objective  accurate  measure.  To  this  end,  we 
decided  to  build  a  surface  model,  satisfying  the  set  of  assumptions  which  would  allow  us  to 
apply  our  depth  reconstruction  program  unmodified  yet  still  use  true  texture  and  real  imagery 
and  have  an  objective  ground  truth.  The  assumptions  we  needed  to  address  were  texture 
isotropy,  zero  boundaries  and  smooth  surfaces.  We  built  a  model,  approximately  two  feet  square 
and  six  inches  high,  composed  of  a  ’blanket’  of  paper-mache,  with  wood  cuttings  glued  on  as 
texture.  We  found  these  materials  enabled  us  to  satisfy  our  requirements,  since  in  addition  to 
isotropy,  zero  boundaries  and  smoothness,  we  would  be  able  to  accurately  measure  the  true 
depths  using  a  3-D  sonic  digitizer,  and  easily  acquire  a  high  resolution  photograph  from  a 
sufficient  distance  to  approximate  orthographic  projection  (20  Meters).  The  enlarged 
photographed  was  then  scanned  at  300  dpi  to  give  us  a  large  data  set  with  which  to  recover 
known  depths. 

4.2  Conclusions 

In  summary,  we  have  shown  that  the  method  has  performed  well  on  synthetic  data.  We  are  still 
testing  this  algorithm  on  the  real  images  acquired  from  our  surface  constructed  as  a  test  case.  We 
will  then  compare  these  results  with  depths  measured  directly.  If  we  can  successively  recover 
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depth  in  this  fashion,  we  believe  we  wUl  have  completed  the  first  shape  from  texture  system  to 
provide  true  shqw  (depth  information)  firom  real  images  of  naturally  textured  surfaces  verified 
against  objective  measurements. 
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Figure  4-2;  Relation  of  Depths  and  Orientations  for  Objective  Function 
(a)  shows  a  good  relationship  for  effectively  using 
the  depth  information 

(b)  shows  a  case  where  the  central  depths  (circled)  become 
coupled  and  their  effects  canceled. 
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Figure  4«3:  Example  of  Smooth  Reconstructed  Surface.  Table  shows 
the  change  in  the  average  eiror  in  the  reconstruction 
for  different  amounts  of  multiplicative  Gaussian  noise 
whose  standard  deviations  are  given.  Also  shown  are  the 
number  of  iterations  required  for  the  relaxation 
to  reach  a  fixed  rate  of  change. 


Figure  4>4:  Example  of  Reconstructed  Surface  with  Significant  Noise 
a^ed  to  Orientation  Measurements.  Surface  on  the  left 
shows  the  true  depths.  Surface  on  the  right  is  the 
reconstruction.  Notice  the  high  frequency  error  in  the 
reconstruction. 


4J  An  Integrated  System  That  Unifies  Multiple  Shape  From  Texture 
Algorithms 

Mark  L.  Moerdler  and  John  R.  Render 

This  section  describes  an  approach  to  the  classification  and  segmentation  of  textured  imagery. 
The  approach  utilizes  information  derived  during  the  recovery  of  surface  shape  parameters, 
which  are  generated  by  a  system  that  integrates  multiple  shape-from  cues. 

The  robustness  of  this  approach  is  illustrated  by  a  system  that  integrates  several  shape-from- 
texture  cues,  recovering  not  only  shape  information  but  also  segmenting  images  into  surfaces 
and  aiding  in  the  classification  of  the  surface  textures.  One  example  is  given  of  the  system 
operating  on  real,  camera-acquired  imagery. 

The  multiple  shape-from-texture  paradigm,  first  proposed  by  Moerdler  [14,  IS],  can  aid  in 
texture  analysis  because  of  the  way  in  which  shape-from-texture  cues  function.  Specifically, 
texture  can  be  used  to  derive  the  shape  of  surfaces  if  a  priori  assumptions  are  made  about  the 
surface  texture.  Individually,  shape-from-texture  cues  are  limited  by  their  underlying 
assumptions,  yet  if  integrated  into  a  large  system  comprised  of  multiple  cues,  they  allow  the 
surface  orientation  to  be  recovered.  The  specific  cues  that  are  used  to  derive  the  chosen  surface 
orientation  can  be  found  and  their  underlying  assumptions  used  to  restrict  the  class  of  possible 
textures.  If  a  large  enough  group  of  shape-from-texture  methods  is  used,  then  the  texture 
analysis  problem  becomes  greatly  constrained  [15]. 

The  surface  segmentation  problem  can  be  simplified  utilizing  information  generated  during  the 
operation  of  a  multiple  shape-from-texture  system.  In  such  a  system,  each  orientation  constraint 
is  generated  using  more  than  one  texture  element  (or  texel).  Once  the  surface  parameters  have 
been  recovered  the  constraints  can  be  re-analyzed  and  the  texels  that  were  used  to  generate  the 
surface  parameters  can  be  combined  into  groupings.  As  will  be  shown  below,  these  groups  are  a 
first  approximation  to  surface  segmentation.  Additional  segmentation  information  can  be 
supplied  by  the  texture  analysis  component,  if  the  various  surfaces  in  the  image  differ  in  their 
textures. 

The  robustness  of  this  approach  is  illustrated  by  a  system  that  integrates  three  shape-from-texture 
cues:  shape-from-uniform-texel-spacing  [11],  shape-from-uniform-texel-size  [16],  and  shape- 
from- virtual-parallel- lines  [15].  These  three  cues  generate  orientation  constraints  for  different 
overlapping  classes  of  textures,  thus  limiting  the  texture  analysis  problem  and  aiding  in  surface 
segmentation.  It  is  important  to  note  that  any  of  a  large  range  of  shape-from-texture  cues  could 
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be  integrated  in  an  (^)eration  system,  thus  increasing  the  robustness  of  the  system’s  shape 
recovery,  texture  classification,  and  surface  segmentation  abilities. 


4,3.1  Design  Methodology 

In  this  section,  we  will  summarize  the  design  methodology.  Additional  detail  can  be  found  in  the 
annual  report  [9].  At  the  center  of  a  texture  analysis  and  image  segmentation  system  is  the  shape 
recovery  component  This  coit^nent,  based  on  the  interaction  between  multiple  shape-from- 
texture  cues,  effectively  drives  texture  analysis  and  image  segmentation.  The  cues  that  comprise 
the  shape-from-texture  component  are  based  on  assumptions  about  both  the  texture  and  the 
surface  segmentation.  These  assumptions  are  tested  during  the  constraint  fusion  phase  and 
information  about  the  type  of  texture  and  the  surface  segmentation  are  generated. 

We  first  discuss  how  the  integration  of  multiple  shape-from-texture  cues  derives  surface  shape 
parameters.  We  then  describe  how  the  underlying  assumptions  of  the  shape-from-texture  cues 
can  be  used  to  classify  the  surface  texture  while  creating  a  first  approximation  to  the  combination 
of  textured  surface  patches  into  surfaces. 

The  generation  of  orientation  constraints  from  perspective  distortion  is  performed  using  one  or 
more  image  texels.  The  orientation  constraints  can  be  considered  as  local,  defining  the 
orientation  of  individual  surface  patches  (called  texel  patches*)  each  of  which  covers  a  texel  or 
group  of  texels.  This  definition  allows  a  simple  extension  to  the  existing  shape-from-texture 
methods  beyond  their  current  limitation  of  planar  surfaces  or  simple  non  planer  surfaces  based 
on  a  single  texturai  cue.  The  problem  can  then  be  considered  as  that  of  intelligently  fusing  the 
orientation  constraints  per  patch.  This  process  can  be  broken  down  into  three  phases: 

1.  creation  of  texel  patches  and  multiple  orientation; 

2.  computation  of  constraints  for  each  patch; 

3.  unification  of  orientation  constraints  per  patch  into  a  "most  likely"  orientation. 

During  the  first  phase,  the  different  shape-from-texture  components  generate  texel  patches  and 
augmented  texels.  Each  augmented  texel  consists  of  the  2-D  description  of  a  texel  patch  and  a 
list  of  weighted  constraints  on  its  orientation.  The  orientation  constraints  for  each  patch  are 


*Texel  patches  are  defined  by  how  each  method  utilizes  the  texels.  Some  methods  (e.g.  uniform  texel  size)  use  a 
measured  change  between  two  texels;  in  this  case  the  texel  patches  are  the  texels  themselves.  Other  methods  (e.g. 
uniform  texel  density)  use  a  change  between  two  areas  of  the  image;  in  this  case  the  texel  patches  are  these 
predefined  areas. 
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potentially  inconsistent  or  incorrect  because  the  shape-from  methods  are  applied  to  noisy  images, 
are  locally  based,  and  derive  constraints  without  a  priori  knowledge  of  the  type  of  texture  or 
number  of  surfaces. 

In  the  second  phase,  all  the  orientation  constraints  for  each  augmented  texel  are  consolidated  into 
a  single  "most  likely"  orientation  by  a  Hough-like  transformation  on  a  tesselated  Gaussian 
sphere.  During  this  phase  the  system  will  also  merge  together  all  augmented  texels  that  cover 
the  same  area  of  the  image.  This  is  necessary  because  some  of  the  shape-from  components 
define  "texel"  similarly,  thus  the  constraints  generated  should  be  merged  and  a  single  orientation 
generated  for  the  surface  patch.  In  those  instances  where  more  than  one  "most  likely"  orientation 
is  found,  the  system  re-analyzes  the  texel’s  constraints  and  checks  their  validity  as  measured  in 
relationship  to  other  texels.  This  allows  it  to  prune  out  some  of  the  constraints  and  possibly 
remove  one  or  more  of  the  "most  likely"  orientations  resulting  in  a  single  orientation.  This  is  a 
type  of  symbolic  segmentation  where  segmenting  is  applied  to  the  "intrinsic  image"  of  surface 
orientation. 

Once  the  individual  oriented  surface  patches  have  been  found,  the  system  re-analyzes  the 
orientation  constraints  to  recover  the  valid  constraints.  The  system  uses  the  valid  constraints  in 
both  simplifying  texture  analysis  and  surface  segmentation.  The  term  “valid  constraints” 
denotes  those  constraints  that  were  used  to  generate  a  solution  rather  than  connoting  any  world 
knowledge  that  the  constraints  are  correct. 

The  valid  orientation  constraints  are  determined  individually  for  each  surface  patch.  The 
constraints  on  the  orientation  of  each  surface  patch,  as  stored  in  the  augmented  texel,  are 
compared  to  the  patch’s  orientation.  Each  constraint  that  fulfills  the  orientation,  within  an 
approximation,  is  considered  as  valid.  This  approximation  is  based  on  the  quantization  with 
which  the  orientation  was  originally  computed*. 

4.3.2  Recovering  Texture  Classification 

Texture  classification  is  performed  by  computing  which  of  a  group  of  features  describe  a  given 
texture.  As  yet  no  single  set  of  features  differentiates  all  possible  textures  [13].  Instead, 
researchers  have  proposed  different  types  of  features  for  specific  classes  of  textures.  It  should  be 
noted  that  some  of  the  features  that  have  been  proposed  are  ad  hoc  in  nature  rather  than  based  on 
intrinsic  properties  of  “texture.” 


*The  Gaussian  sphere  is  tesselated  and  any  surface  orientations  generated  using  it  are  approximate. 
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The  underlying  assunq)tions  of  existing  shape-from-texture  cues  limit  the  class  of  textures  to 
which  the  cue  is  applicable.  If  it  can  be  established  which  cue  is  applicable  to  a  specific  texture, 
it  is  in  effect  equivalent  to  deriving  the  texture  classification.  Since  this  classification 
information  is  unavailable  prior  to  deriving  the  surface  shape,  the  multiple  shape-fiom-texture 
paradigm  applies  all  of  the  cues  to  the  image.  After  the  knowledge  fusion  phase  the  system  is 
able  to  determine  the  valid  constraints  and  therefore  which  assumption  are  valid  for  each  texel. 

The  underlying  assumptions  of  shape-from-texture  cues  attempt  to  model  the  intrinsic  properties 
of  texture  (e.g.  uniform  space,  uniform  size  etc.  [7]).  The  texture  classification  algorithm  above 
is  therefore  based  on  a  model  of  texture.  If  a  large  number  of  cues  are  used,  the  texture  model 
becomes  more  complex  and  is  better  able  to  describe  both  natural  and  synthetic  texture. 

If  surface  segmentation  is  performed  at  the  same  time  as  texture  classification  then  not  only  can 
the  image  be  partitioned  into  regions  but  a  texture  model  can  be  generated  for  each  region  in  the 
image. 

4.3  J  Approximating  Surface  Segmentation 

Previous  texture  based  segmentation  algorithms  [12, 17]  partitioned  images  into  regions  based 
on  differences  in  the  image  texture.  The  difference  is  defined  as  a  measured  change  in  some 
feature  or  features  of  the  texture  (also  called  texture  measures).  Depending  on  the  specific  group 
of  features  used,  an  image  may  be  segmented  into  different  regions. 

Since  these  methods  use  only  texture  classification  based  information  to  partition  the  image,  the 
segmented  regions  do  not  necessarily  correspond  to  surfaces.  If  the  features  are  either  too 
sensitive  or  do  not  really  model  the  world,  the  surfaces  will  be  partitioned  into  multiple  regions. 
At  the  other  extreme,  if  the  features  do  not  correspond  to  all  of  the  attributes  of  the  texture  then 
regions  of  the  image  may  contain  more  than  one  surface.  An  additional  handicap  of  these  texture 
segmentation  algorithms  is  that  they  are  unable  to  correctly  panition  images  containing 
overlapping  transparent  textured  surfaces. 

Perceived  texture  (camera  or  otherwise  acquired)  is  the  product  of  numerous  physical  processes. 
If  segmentation  is  to  be  more  exact  then  it  should  consist  of  more  than  measured  changes  in 
attributes  of  the  texture.  The  multiple  shape-from-texture  paradigm,  described  above,  can  easily 
be  extended  to  aid  in  surface  segmentation.  Implicit  in  the  constraint  generation  component  of 
the  algorithm  is  the  assumption  that  the  image  contains  a  single  textured  surface.  This 
assumption  manifests  itself  in  the  generation,  by  each  of  the  cues,  of  constraints  on  the 
orientation  of  all  possible  groups  of  texels.  This  is  necessary  since  no  a  priori  segmentation 
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infonnadon  is  available. 


So  long  as  texture  is  assumed  not  to  miniic  perspective  distortion  effects,  texel  groupings  that 
cross  surface  boundaries  will  create  pseudo-random  orientation  constraints.  If  a  number  of 
correct  constraints  are  generated,  then  these  pseudo-random  constraints  will  not  affect  the  system 
in  choosing  the  cmrect  constraints  and  thus  will  not  be  included  in  the  valid  constraints. 

Once  the  valid  constraints  have  been  recovered,  after  the  system  has  selected  the  surface 
orientation  parameters,  a  segmentation  of  the  image  can  take  place.  Each  valid  constraint  is 
generated  by  one  of  the  shape-firom-texture  cues  utilizing  one  or  more  texels.  Since  the  constraint 
is  valid  the  texels  must  be  part  of  the  same  surface  patch  and  can  be  grouped  together.  By 
iterating  through  all  of  the  valid  constraints  the  texels  can  be  grouped  together  to  form  surfaces. 

The  surfaces  are  generated  by  combining  texels  based  on  orientation  information  and  texture 
classification  assumptions.  This  allows  a  greater  flexibility  in  the  surface  segmentation.  Images 
con:aining  surfaces  with  closely  located  texels  as  well  as  images  containing  transparent 
overlapping  surfaces  (see  [15])  can  be  segmented. 

4  J.4  Test  Domain 

There  are  two  basic  classes  of  shape-fiom-texture:  texel  based  (normally  "man-made"  textures, 
e.g.  aerial  imagery  of  cities)  and  texel  grouping  based  (normally  "natural”  textures,  e.g.  tree 
bark).  In  the  texel  based  methods  (e.g.  shape-from-uniform-texel-size  [16])  the  textural  elements 
are  large  and  there  is  texel  to  texel  uniformity  in  the  unoriented  textured  surface.  In  the  texel 
grouping  based  methods  (e.g.  shape-from-edge-isotropy  [19, 6])  the  uniformity  in  the  texture  can 
only  be  measured  across  groupings  of  texels  (normally  edge  elements). 

A  test  system  has  been  implemented  that  contains  three  texel  based  methods:  shape-from- 
uniform-texel-spacing  [11],  shape-from-uniform-texel-size  [16],  and  shape-from-virtual-parallcl- 
lines  [15].  In  this  system  the  texel  patches  arc  generated  by  a  simple  histogram  bin  thresholding 
algorithm  that  defines  each  eight  connected  blobs  as  a  single  texel. 

Shape-from-uniform-texel-spacing  derives  orientation  constraints  based  on  the  assumption  that 
the  surface  texels*  can  be  of  arbitrary  shape  but  arc  equally  spaced.  The  method  takes  groups  of 
three  texels  and  derives  an  orientation  constraint  based  on  the  change  in  spacing  between  them 
(for  the  mathematical  formulation  see  [15]). 


*A  surface  texel  is  defined  as  the  undistorted  texel,  as  compared  to,  an  image  texel  which  is  the  distorted  version 
appearing  in  the  image. 
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The  uniform  spacing  assumption  constrains  the  class  of  textures  to  which  the  cue  is  applicable. 
Therefore,  if  the  cue  generated  valid  constraints,  then  fm*  those  texels  used  in  generating  the 
valid  constraints  die  texture  must  be  uniformly  spaced.  If  all  of  the  constraints  in  a  region  of  the 
image  are  found  to  be  uniformly  spaced  the  result  is  similar  to  that  recovered  by  a  spatial 
frequency  feature  of  a  standard  texture  analysis  algorithm  [13]. 

The  Second  shape-from-texture  method,  shape-from-uniform-texel-size,  utilizes  the  assumption 
that  the  surface  texels  are  of  uniform  size,  but  not  necessarily  of  uniform  shape,  prior  to  the 
effects  of  perspective  distortion.  This  assumption  is  unrelated  to,  but  not  inconsistent  with,  the 
assumptions  of  either  of  the  previous  cues. 

Given  the  size  of  two  image  texels  and  the  spacing  between  the  texels,  the  shape-from-uniform- 
texel-size  cue  can  recover  an  orientation  constraint  (for  a  mathematical  formulation  see  [15]). 
Since  a  texture  is  assumed  to  have  more  than  two  texels,  this  cue  is  able  to  generate  sufficient 
constraints  to  solve  the  surface  parameters. 

The  Third  shape-from-texture  method  is  shape-from-virtual-parallel-lines.  The  major 
assumption  of  this  cue  is  that  the  surface  texels  are  located  on  virtual  parallel  lines  [15].  This  is  a 
related  weaker  assumption  to  that  of  shape-from-uniform-texel-spacing. 

A  virtual  line  is  defined  as  the  imaginary  line  connecting  the  center  of  mass  of  two  or  more 
image  texels.  Other  virtual  line  definitions  are  possible  and  would  generate  additional  orientation 
constraints.  Since  the  virtual  lines  that  connect  the  texels  are  parallel  on  the  surface,  the  lack  of 
parallelness  in  the  image  constrains  the  surface  orientation.  The  point  at  which  the  lines 
converge  is  a  vanishing  point,  which  by  definition  is  an  orientation  constraint. 

The  three  cues,  described  above,  are  a  useful  subset  of  all  possible  shape-from-texture  cues. 
They  arc  able  to  resolve  the  surface  parameters  of  a  class  of  difficult  textured  surfaces  (see  [15]). 
Furthermore,  as  will  be  shown  in  the  next  section,  they  can  segment  images  into  surfaces  and  are 
useful  in  limiting  the  class  of  textures  and  aiding  in  surface  segmentation. 

4.3.5  Experimental  Results 

The  system  has  been  tested  over  a  range  of  both  synthetic  and  natural  textured  surfaces,  and 
shows  robustness  and  generality.  We  show  here  one  example  of  real,  noisy  image  that 
demonstrates  the  applicability  of  a  multiple  shape-from-texture  system  to  shape  recovery,  texture 
analysis,  and  image  segmentation. 

The  image  (see  figure  4-5)  shows  a  camera-acquired  image  of  a  computer  terminal  keyboard. 
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The  key  tops  are  chosen  by  the  system  as  texels  due  to  the  grey  level  disparity  between  them  and 
the  majority  of  the  pixels  in  the  image.  The  key  top  texels,  shown  in  figure  4-5,  are  uniformly 
sized.  They  are  also  uniformly  spaced  horizontally,  and  approximately  uniformly  spaced 
vertically.  Unfortunately,  they  are  not  linearly  positioned  in  any  but  the  horizontal  direction, 
therefore  the  only  constraints  generated  by  shape-firom-uniform-iexel-spacing  are  in  the 
horizontal  dimension. 


Figure  4-5:  A  computer  terminal  keyboard 
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The  key  top  texels  are  poorly  defined  in  the  image  due  to  digitization  and  camera  focus  errors. 
Furthermore,  many  of  the  key  tops  are  inscribed  with  letters  and  have  shadows  cast  upon  them. 
Therefore,  the  threshold  based  blob  finding  algorithm  has  difficulty  in  correctly  recovering 
texels,  as  shown  in  figure  4-6.  Yet  the  system  is  able  to  generate,  for  most  of  the  texels,  the 
correct  mientation  within  the  measurement  error  (sec  figure  4-7)). 


Figure  4-6:  The  texels  of  figure  4-5 


Texture  analysis  determines  that  all  of  the  texels  in  the  image  arc  uniformly  sized,  uniformly 
spaced  horizontally,  and  arc  located  on  parallel  horizontal  lines.  This  information,  which  is 
easily  recovered  by  the  integrated  approach,  strongly  constrains  the  texture  classification 
problem.  Furthermore,  as  more  shape-from-texture  cues  (e.g.  shape-fiom-texel-isotropy  [19])  arc 

added  to  the  system,  texture  analysis  wUl  be  able  to  generate  additional  texture  classification 
information. 

Surface  segmentation  groups  the  texels  of  figrue  4-5  into  four  separate  horizontal,  groupings 
based  on  information  generated  by  shape-from-uniform-tcxel-spacing  and  shape-firom-virtual- 


Figure  4-7:  The  surface  orientation  values  for  the  image  containing 
the  computer  keyboard 
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parallel-lines. '  Shape-firom-unifoim-texel-size  supplies  additional  information  that  allows  the 
horizontally  grouped  texels  to  be  combined  into  a  single  surface.  The  system  is  able  to  recover  a 
single  surface  where  many  purely  feature-based  segmentation  methods,  such  as  some  spatial 
features  methods,  would  fail. 

43.6  Conclusion  And  Future  Research 

In  this  section  we  described  a  system  that  can  integrate  multiple  shape-fiom-texture  cues  into  a 
single  system  that  not  only  generates  surface  shape  parameters,  but  also  performs  texture 
analysis  and  surface  segmentation.  The  system  has  been  tested  using  three  shape-from  methods: 
shape-from-uniform-texel-spacing,  shape-from-unifonn-texel-size,  and  shape-firom-virtual- 
parallel-lines  and  has  shown  the  ability,  under  noisy  conditions,  to  recover  surface  orientation, 
aid  in  texture  classitication  and  segment  images  into  surfaces. 

The  segmentation  algorithm  does  not,  as  yet,  supply  any  additional  information  that  shows 
exactly  where  the  surface  break  should  occur.  This  information  will  have  to  be  supplied  by  other 
surface  segmentation  algorithms  that  would  be  integrated,  in  the  future,  with  the  multiple  shape- 
ftom-texture  system  to  derive  a  more  general  vision  system. 

The  robustness  of  the  system  has  been  demonstrated  using  images  that  contain  multiple  surfaces, 
surfaces  that  arc  solvable  by  any  of  the  methods  alone,  and  finally  with  images  that  arc  solvable 
by  using  only  a  combination  of  methods. 

Future  enhancements  to  the  system  will  include  the  addition  of  other  shape-from-texture 
modules,  the  optimization  of  the  method,  especially  in  a  parallel  processing  environment,  and  the 
integration  of  addition  shape-ftom  methods  (e.g.  shapc-from-contour  or  shape-from- binocular- 
stereo).  Other  forms  of  texture  analysis  and  surface  segmentation  will  also  be  fused  into  the 
multiple  shape-from-texture  system  to  create  a  more  general  texture-based  vision  system. 
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5.  Condusion  and  Future  Research 

In  die  first  stage  of  this  project,  we  have  developed  and  implemented  several  parallel  stereo  and 
texture  vision  algivithms  highly  parallel  computer  architectures.  They  include  a  new 
autocmrelation-based  texture  algorithms,  multi-resolution  stereo  algorithms,  and  depth 
inteqmlation  algoridims.  Initial  results  on  the  integration  of  stereo  and  texture  information  have 
been  obtained,  and  a  system  for  fusion  of  information  from  various  shape-from-texture  methods 
has  been  developed.  Also,  initial  results  of  integrating  stereo  and  texture  have  been 
demonstrated.  An  environment  to  program  pyramid  and  multi-resolution  algorithms  on  the 
Connection  Machine,  a  highly  parallel  fine-grained  SIMD  machine,  has  been  developed,  and  has 
been  used  to  implement  several  primitives  of  the  developed  parallel  algorithms. 

The  second  stage  of  this  project  as  initially  proposed  called  for  the  detailed  implementation  of 
the  developed  algorithms  on  highly  parallel  architectures,  including  the  newly  developed 
textured  algorithms  and  the  system  that  fuses  information  from  various  shape-from-texture 
methods.  Another  continuation  for  this  research  is  to  develop  and  implement  parallel  algorithms 
for  computer  vision  based  on  strong  mathematical  foundations  such  as  Information-Based 
Complexity  (IBC).  They  include  optic  flow,  shape-from  shading,  shape-from-texture,  and 
shape-from-stereo  algorithms.  In  implementing  these  algorithms,  two  parallel  architectures  can 
be  studied  for  performance;  namely  the  Connection  Machine  and  the  WARP  machine  (a  10-stage 
pipelined  high  performance  machine). 

The  implemented  systems  will  integrate  the  information  from  stereo  and  texture  methods  to 
increase  the  certainty  of  computing  surface  parameters  in  the  image,  and  they  can  be  augmented 
by  the  use  of  landmarks  for  position  location  (the  calculation  of  the  global  area),  which  can 
improve  the  performance  of  an  autonomous  land  vehicle  navigation  system. 

Other  research  areas  is  to  investigate  integrating  information  from  vision  and  odometry  cues  to 
accurately  correct  the  position  location  computation.  This  research  will  result  in  experiments 
that  can  be  directly  applied  to  a  land  vision  systems  such  as  using  our  new  texture  algorithms  for 
determining  surface  slopes  in  a  natural  environment,  and  the  use  of  the  position  location  system 
to  correct  errors  in  odometry  and  other  distance  measurement  systems. 


28 


Appendix 


29 


1.  Pyramid  Emulator  Code  on  the  Connection  Machine 


The  listings  which  follow  include  all  the  code  which  is  necessary  to  run  the  pyramid  emulator  as 
described  in  the  User’s  Manual  for  Pyramid  Emulation  on  the  Connection  Machine.  As 
described  in  the  chapter  entitled  "Getting  Started",  if  you  load  the  file  "pyramid-emulate.lisp",  all 
the  other  files  will  be  loaded  appropiately.  Alternatively  you  can  load  "pmd-iniLlisp"  as  a  simple 
test  The  files  are  included  in  this  section  in  the  same  order  as  they  are  loaded  in,  which  is; 

pyramld-«mulato . lisp 

—  this  file  loads  the  pyramid  emulator 
and  initializes  the  system 

poul-util , lisp  —  utility  routines  for  pyramid  emulator 

(low  level  functions  -  transparent  to  user) 

pmd-prime . lisp  —  pyramid  primitives  (allocating,  defining, 

and  setting  pyramids  and  their  levels) 

shift-news . lisp  —  intra-level  pyramid  communication  functions 

top-down . lisp  —  inter-level  pyramid  communciation  functions 

pod-display .lisp  —  pyramid  display  routines 

ctibe-grid .  lisp  —  addressing  scheme  needed  for  display 

pmd-conv.lisp  —  pyramidal  convolution  routines 

make-mask . lisp  —  standard  masks  used  for  convolution 

pod-pref . lisp  —  "pref"  function  for  pyramids  (parallel 

pyramid  references) 

pod-edges . lisp  —  routines  for  pyramidal  edge  finding 

pod- load. lisp  —  loading  image  data  from  files  into  pyramids 

pod-un load. lisp  —  unloading  pyramids  into  image  files 

pod-init .lisp  —  file  used  to  test  a  pyramid  set-up 

pod-example  —  file  containing  example  of  user' s  session  on 

the  Connection  Machine  showing  how  the  emulator 
is  loaded  in  and  used. 
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;  f 11« :  pyramid-omulata . lisp 
;by:  Cindy  Noxnan/Lisa  Brown/Qifan  Ju 

;data:  2/88,  5/88 
;var8ion:  1.0 


LOAD  ALL  FILES  NEEDED  FOR  PYRAMID  EMULATION 


;fila  with  pyramid  emulation  utility  routines 
(load  "pmd-util . lisp"  : verbose  nil) 

;file  containing  pyramid  primitives 
(load  "pmd-prime.lisp"  : verbose  nil) 

; files  with  pyramid  communication  routines 
(load  "shift -news .lisp"  .'verbose  nil) 

(load  "top-down . lisp"  : verbose  nil) 

/files  containing  routines  for  pyramid  display 
(load  "pmd-display . lisp"  : verbose  nil) 

(load  "cube-grid. lisp"  /verbose  nil) 

/for  convolution 

(load  " pmd- con V. lisp"  /verbose  nil) 

/for  the  test  of  convolution,  making  some  arrays 
(load  "make-mask. lisp"  /verbose  nil) 

/function  to  get  values  from  pmd 
(load  "pmd-pref .lisp"  /verbose  nil) 

/find  edges  in  pmd 

(load  "pmd-edges . lisp"  /verbose  nil) 

/files  for  interface  with  image  data  in  files 
(load  "pmd- load. lisp"  /verbose  nil) 

(load  "pmd-unload. lisp"  /verbose  nil) 


/main  function  for  doing  all  pyramid  emulation 
(defun  pyramid-emulate  (fioptional  number-of- levels) 
(format  t  "-%-%  ****  Pyramid  Emulation  *****-%~%") 

(format  t  "  —  version  1.0 - %-%") 

(cond  ( (test-for-pyramid-configuration) 

(cond  ( (eq  number-of- levels  nil) 
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(setq  *paid-nuinb«r-of-l«v«la* 

(+  1 

(/  *log~nuinbttr-of-proc«s8ors- limit*  2) ) ) ) 

(t  (cond  ( («  numbar-of-*l«v«la 
(+  1 

(/  *lo9-nuiiiber-of-‘procaaaora~limit*  2))) 
(aetq  *pmd-number-of-lavala*  numbar-of-levela) ) 
(t  (format  t 

(***  error:  iaq>roper  auaiJ3er-of-levala'«'%") ) ) ) ) ) 
(t  (format  t  "***  error:  improper  configuration  *'%"))) 

;  Define  other  global  variablea  needed  by  pyramid 
;  emulation 

;aize  of  one  aide  of  baae  of  pyramid 

(aetq  *pmd-size*  (dimension-aize  0)) 

;aapping  of  hypercube  connections  to  addressing  scheme 
(*defvar  *pmd-self-address*  (self-address ! f ) ) 

/each  processor  gets  its  non-zero  level  number 

(*defvar  *pmd- level-number*  (assign-levels!!)) 

/lists  needed  for  pyramid  communications 
(setq  *pmd-north-south-list* 

(build-north-south-list  *pmd-size*) ) 

(setq  *pmd-east-west-list* 

(build-east-west-list  *pmd-size*) ) 

/list  of  all  pyramids  created 
(setq  *pmd-names*  nil) 

t 


)  / end  pyramid-emulate 


f !!• :  pad-util . lisp 


;  returns  pvar  idiich  is  T  whan  tha  valua  is  a  whola  nunbar 
;  (dafun  intgp! !  (pvar) 

;  (cond! !  ((«!!  pvar  (round!!  pvar))  t!!)  (t!!  nil!!))) 

;this  procadura  figuras  out  to  what  powar  of  2  the  number  is. 
;a.g.  if  given  16,  it  will  sand  back  4. 

(dafun  powar-of-2  (num) 

(cond  ( (s  (log  num  2)  (round  (log  num  2)))  (round  (log  num  2))) 
;num  ok 

(t  (print  "size  is  not  a  powar  of  2")  ;num  not  ok 
'nil))) 

/this  function  will  send  back  the  i(th)  bit  of  address 
/address  is  parallel,  i  is  not. 

(*dafun  *gat-bit  (  i  paddrass) 

(cond!!  (  (>!!  (!!  0) 

(logand! !  paddrass  (!!  (expt  2  (-  i  1))))) 
/if  AllD  of  paddrass  and  2**(i-l)  =  0,  than  bit  is  0  else  1 
(!!  0)) 

(t!!  (!!  1)))) 

/this  just  subs  1  from  even  numbers  and  leaves  alone  if  odd 
(defun  set-odd  (nxim) 

(cond  (  (evenp  num)  (-  num  1)) 

(t  n\im))) 

/this  just  adds  1  to  odd  nvimbers  and  leaves  alone  if  even 
(dafun  sat-aven  (num) 

(cond  (  (oddp  num)  (-)■  num  1) ) 

(t  num))) 

/used  by  assign- levels ! ! 

(dafun  intgp! !  (pvar) 

(*lat  ((  tpvar  nil!!)) 

(*when  (*! !  pvar  (!!  0)) 

(*sot  tpvar  t!!)) 

(*when  (/=! !  pvar  (!!  0)) 

(*set  tpvar  nil!!)) 

tpvar) ) 

/sat  each  processor  to  the  niuober  of  the  level  of  the  pyramid 
/that  it  emulates  (since  all  emulate  zero,  assign  it  zero 
/ only  when  that  is  tha  only  level  it  emulates . ) 

(*dafun  * set- level  (pvar  level) 

(*when  (intgp!!  (mod!!  (+!!  *pnd-self-address* 
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(!!  («xpt  2  (-  l«v«l  1)))  ) 
(  ! !  (•xpt  4  ) ) ) 

(*8ttt  pvar  ( ! !  l«v«l) ) ) ) 

(*d«fun  «sslgn-lttv»l8 ! !  () 

(*all 

(*l«t  ((ploval  (!!  0))) 

<do 

(  (x  (-  *pmd-nuinb«r-o£-l«v®ls*  1)  (-  x  1) ) ) 

(  (»  X  0)  t) 

(*when  («! !  plovel  (!!  0)) 

(*s«t-leval  plavel  x) ) ) 

plaval) ) ) 


this  function  will  creata  tha  antire  list  of  dimensions 
naadad  to  traval  down  for  a  shift  to 
tha  wast  or  east  (odd  ntnnbers)  .  This  list  is  used  for 
all  levels.  Each  level  will  stop  at  different  points  on 
the  list. 

(defun  build-east-west-list  (size) 

;size  is  #  pixels  on  side  of  image 

(build-sel2  (set-odd  (round  (power-of-2  (*  size  size))))  nil)) 


;  this  is  tha  sama  as  build-aast-wast-list  but  builds  tha  list 
;  of  avan  ;numbers-tha  numbars  naaded  for  north-south  shifts, 
(dafun  build-north-south-list  (size) 

/size  is  #  pixels  on  side  of  image 

(build-sel2  (set-even  (round  (power-of-2  (*  size  size))))  nil)) 

;  this  function  actually  builds  the  list  of  send-east 
;  commands  described  on  the  top  of  page  6  of  Hussein's  paper. 

;  this  also  will  build  the  send-north  and  send-south  lists  - 
;  depending  upon  the  parameters,  for  these  two,  you  need  to 
;  send  an  even  number  for  high-num  and  it  will  build  a  list 
;  of  even  numbers  stopping  at  2-which  is  the  stopping 
;  point  for  north/south  sends  (level  0) .  otherwise,  it 
;  will  stop  at  1  which  is  the  stopping  point  for  east/west 
;  sends  (level  0)  Depending  upon  what  level  you  are  working 
;  with  will  depend  upon  how  much  of  this  list  you  will  need. 

;  If  level  0,  you  will  need  the  whole  list,  if  /level  1/send 
/  east-west,  you  will  need  all  but  the  '1'  in  tha  list,  if 
/  north/south  sends,  you  will  need  all  but  the  '2'  in  the  list, 
(defun  build-sel2  (high-num  lis) 

(cond  (  (<  high-ntim  1  )  lis) 

/finished  building  list-STOP  AT  LEVEL  1 

(t  (build-sel2  (-  high-num  2)  (append  lis  (list  high-num)  ))))) 
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;  this  function  tost  that  tha  currant  04  configuration  is 
;  appropriata  for  pyramid  amulation 
(dafun  tast-for-pyramid-configuration  () 

;  nota:  naad  to  raconsidar  thasa  conditions 

(cond  ((and  (intagarp  *log-nuiiibar-of-procassors-liiiiit*) 

(«  *n^jai]3er*-of~dimansions*  2) ) 

(cond  ( (aq  (dimansion-siza  0)  (dimansion-siza  1) ) 
t) 

(t  nil))) 

(t  nil))) 
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9 

;  fll«  :  pod-priiM .  lisp 


;  dsfin*  pmd  as  a  naw  structura  which  has  two 
;  pvars:  top  and  laaf 

(*da£struct  (piad  :  iaiMdiata-data-typa  t) 

(top  (!!  0)  :typa  (signad-pvar  100)) 

(laaf  (!!  0)  :typa  (signad-pvar  100))) 

(*da£un  allocata-pmd! !  () 

(maka-pmd ! ! ) ) 

(*da£un  *daallocata-piiul  (pmd) 

(*daallocata  pmd) 


) 

;  dafina  a  naw  namad  pmd  .  if  it  axists,  rasat  it. 
(dafmacro  *dafpmd  (pmdname  fioptional  init-pmd) 

' (lat  ( (nawnama  (quota  , pmdname) ) ) 

(cond  ( (not  (quota  , init-pmd  )  ) 

( *dafvar  , pmdname  (maka-pmd ! ! ) ) 
nawnama) 

(t  ( *daf var  , pmdname  (maka-pmd ! > ) ) 

(*sat-pmdstruct  ,  pmdname  ,init-pmd) 
nawnama) ) ) ) 


;  sat  the  value  in  pmd2  into  pmdl 
(dafun  *sat-pmd  (pmd-1  pmd-2) 

(cond  ((and  (pvarp  pmd-1)  (pvarp  pmd-2)) 

(cond  ((and  (pmdp  pmd-1)  (pmdp  pmd-2)) 
(*sat-pmdstruct  pmd-1  pmd-2) ) 

(t  (foinoat  t  "-%  not  a  pmd  structure  -%")))) 
(t  (format  t  "-%  not  a  pmd  structure  -%")))) 


;  assign  pmd-2  into  pmd-1 

(*dafun  *sat-pmdstruct  (pmd-1  ^d-2) 

(*all 

(setf  (pmd-top! !  pmd-1)  (pad-top! !  pmd-2)) 
(setf  (pmd-leaf ! !  pmd-1)  (pmd-leaf ! !  pnd-2)))) 

(*deftzn  *sat-pmd-lat  (pmd-1  pmd-2) 

(*all 

(setf  (pad-top!!  pmd-1)  (pad-top!!  pmd-2)) 
(setf  (pmd-leaf!!  pmd-1)  (pmd-leaf!!  pmd-2)))) 
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;  return  a  pmd  structure,  the  value  of  each  processor  is  nua. 
(*defun  pmd! !  (num) 

(awke-pmd! !  :top  (!!  num)  :leaf  (!!  num))) 

;  assign  value  of  the  pvar  to  the  top  and  the  leaf  of 
;  pmdl  structure. 

(*defun  ^set-pmd-pvar  (poidl  pvar) 

(setf  (pmd-top!f  pmdl)  pvar) 

(setf  (pmd-leaf ! !  pmdl)  pvar)) 


;  assign  the  values  of  specific  level  from  pmd-2  to  pmdl . 
(*defun  *set-level-Fmd  (level  pmd-1  pmd-‘2) 

(*all 

(cond  ( (s  level  0) 

(setf  (pmd-leaf ! !  pmd-1)  (pmd-leaf!!  pmd-2))) 
(t  (setf  (pmd-top!!  jaxd-l) 

(cond!!  ((=!!  (!!  level)  *pmd-level-numbar*) 

(pmd-top! !  pmd-2) ) 

(t!!  (pmd-top!!  pmd-1)))))))) 


;  assign  value  of  the  pvar  to  a  specific  level  of  pmdl 
;  structure . 

(*defun  *set-level-pmd-pvar  (level  pmd-l  pvar) 

(*all 

(cond  ( (»  level  0) 

(setf  (pmd-leaf!!  pmd-1)  pvar)) 

(t  (setf  (j»nd-top!!  pmd-1) 

(cond!!  ((=!!  (!!  level)  *pmd- level-number*) 

pvar) 

(t ! !  (pmd-top ! !  pmd-1) ))))))) 


;  get  the  value  when  given  cube  address . 
;  top»l  means  top,  top^O  means  leaf. 
(*defun  pref-cube-pmd  (top  pmd  num) 

(cond  ( (a  top  1) 

(pref-pmd-top  pmd  num) ) 

(t  (pref -pmd- leaf  pmd  num) ) ) ) 


; print  part  of  a  pvar. 

(*defun  *ppp-part  (pvar  size) 

(dotimes  (x  size) 

(dotimes  (y  size) 

(format  T  "-6d  " 

(pref-grid  pvar  x  y) ) ) 
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(t«rpri) ) ) 


;;  poul  structur*  pradlcator. 

(*dafun  podp  (pod) 

(coad  ((*and  (structurap! !  pod)) 
t) 

(t  nil))) 

;  raturn  a  pvar  from  a  pmd  according  to  tha  laval  numbar. 
(*dafun  piiid2pvar! !  (pmd  laval) 

(cond  ( (»  laval  0) 

(pmd-laaf !  !  pmd) ) 

(t  (pmd-top ! !  pmd) ) ) ) 
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f iltt :  shift-naws . lisp 
data:  2/88,  5/88 


This  is  a  support  function  for  tha  *shift  oparations  below. 
<lis>  is  a  list  of  dimensions  (see  build  routines  in 
pmd-util . lisp) 


(*defun  * sand-east- south  (lis  level  source-pvar  dest-pvar) 

;  stop  sanding  after  sending  forward  along  the 
;  2*lavel*t-l  dimension 

(*when  (or!!  (>=! !  (!!  (car  lis)) 

(1+!!  (*!!  (!!  2)  *pmd- level-number*) ) ) 
(=!!  (!!  level)  (!!  0))) 

(cond  (  (eq  nil  (cdr  lis) ) 

(* send- forward  (car  lis) 

source-pvar  dest-pvar) ) 

(t  (*3end-forward  (car  lis) 

source-pvar  dest-pvar) 

(*when  (or!!  (>=! !  (!!  (cadr  lis)) 

(1+!!  (*!!  (!!  2) 
*pmd- level-number*) ) ) 
(»!!  (!!  level)  (!!  0))) 
(*send-backward  (cadr  lis) 

dest-pvar  dest-pvar) ) 
(*send-east-south  (cdr  lis)  level 

source-pvar 
dest-pvar) ) )  ) 

) ;end  *send-east-south 


;this  is  similar  to  *send-east-south  but  in  these  you  have  the 
; pattern  of  sending  starting  with  send-back  then  send-foirward 
;send-back  until  the  end  of  <lis>. 

(*defun  *send-west-north  (lis  level  source-pvar  dest-pvar) 
(*when  (or!!  (>=!!  (!!  (car  lis)) 

(1+!!  (*!!  (!!  2)  *pmd- level-number*) ) ) 
(*!!  (!!  level)  (!!  0))) 

(cond  (  (eq  nil  (cdr  lis) ) 

(*send-backward  (car  lis)  source-pvar 

dest-pvar) ) 

(t  (*send-backward  (car  lis)  source-pvar 

dest-pvar) 

(*when  (or!!  (>=! !  (!!  (cadr  lis)) 

(1+!!  (*!!  (!!  2) 
*pmd- level-number*) ) ) 
(=!!  (!!  level)  (!!  0) ) ) 
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) 


(*sand-*forward  (cadr  lis) 

d«st-pvar  dast-pvar) ) 
(*8and-w«8t-north  (cdr  118)  laval  80urca-pvar 

daat-pvar) ) )  ) 


;and  *8and-iia8t-north 


;8and  data  forward  along  tha  diaansion  <dliB>  from  tha 
;<8ourca-pvar>  to  tha  <dast-pvar> 

(*dafun  *sand-forward  (dim  aourca~pvar  daat-pvar) 

;8pacial  caaa  whan  <dim><BO  (daatsaourca) 

; (format  t  "forward  on  ~2d"  dim) 

(cond  (  (s  dim  0) 

(*all  (*sat  daat-pvar  aourca-pvar) )  ) 

;8and  data  forward  only  if  <dim>th  bit  of  addraaa  ia  zero 

(t  (*whan  (s! !  (!!  0)  (*gat*-bit  dim  *pmd-salf-addrass*) ) 
;data  raceivad  in  procassor  with  same  address 
;but  <dim>th  bit  is  one 

(satf  (praf ! !  dast~pvar  (■!■!!  (!!  (axpt  2  (-  dim  1) ) ) 

Apmd-self-address*) ) 
(praf!!  source-pvar  *pmd-self-address*) ) ) ) 

) ;and  cond 
);and  ^sand-forward 


this  works  tha  sama  as  *sand-forward  except  an  operation  is 
performed  on  tha  data  being  sent  and  the  data  at  the 
address  of  the  destination  (both  from  source-pvar)  before 
it  is  placed  into  the  dest-pvar. 


(*defun  * send- forward-op  (dim  source-pvar  dest-pvar  op) 

;send  data  forward  only  if  <dim>th  bit  of  address  is  zero 
(*when  (»! !  (!!  0)  (*get-bit  dim  *pmd-self-address*) ) 

(setf  (praf!!  dest-pvar  (+! !  (!!  (expt  2  (-  dim  1)}} 

*pmd-self-address*) ) 
;this  calls  the  function  sent  in  <op>  &  applies  to  psource 
;of  first  address  and  psource  of  second  address. 
(*funcall  op  (pref!!  source-pvar  *pmd-self-address*) 

(pref ! !  source-pvar  (+!! 

(! !  (expt  2  (-  dim  1)}) 
*pmd-self-address*) ) ) 


) ;end  setf 
) ;end  when 
);end  *send-forward 


;  this  works  the  same  as  *send-forward  except  that  the 
;  dimension  <diffl>  is  travelled  'back'  on.  The  data  in 
;  source-pvar  whose  <dim>th  bit  of  its  address  is  1  is  sent  to 
;  dest-pvar  at  the  corresponding  address  whose  <dim>th  bit  is  0 . 
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(*dafun  *8«nd~b«clnrard  (dim  sourcm-pvar  dast-pvmr) 

;  (format  t  "backward  on  -2d"  dim) 

(cond  (  (<■  dim  0) 

(*all  (*8«t  da8t~pvar  8ourca-pvar) )  ) 

(t  (*^an  («! !  (!!  1)  (*gat-bit  dim  *paid-8alf-addra88*) ) 
(8atf  (prof!!  d08t-pvar  (-!!  *pmd-8alf-addro88* 

(! !  (oxpt  2  (-  dim  1) ) ) ) ) 
(prof!!  sourco-pvar  *pmd-solf-addross*) ) )  ) 

) ; ond  cond 

) ; ond  *8ond-backward 


(*dofun  *8hift  (diroction  lovol  sourco-pvar  dost-pvar) 
(cond  (  (oq  diroction  'o) 

;uso  oast-wost-list  :tho  odd  numbors 
(*8ond-oast-south  *pmd-oast-wost-list*  lovol 

sourco-pvar  dost-pvar) ) 

(  (oq  diroction  'w)  ; 

(*sond-wo8t-north  *pmd-oast-wost-list*  lovol 

sourco-pvar  dost-pvar) ) 

(  (oq  diroction  'n) 

;uso  north-south-list  :  tho  ovon  numbors 
(*sond-wost-north  *p!ad-north-south-list*  lovol 

sourco-pvar  dost-pvar) ) 

(t  ; (oq  diroction  ' s) 

(*send-oast-south  *pmd-north-south-list*  lovol 

sourco-pvar  dost-pvar) )  ) 


) ;ond  *shift 


this  function  will  only  shift  a  particular  level, 
tho  'all  is  used  because  if  some  other  function  had 
a  subset  of  processors  sot  before  this  one  is  called,  all 
of  the  processors  may  not  bo  checked  for  the  *whQn  clause. 


(*defun  shift-lovol-pmd! !  (lovol  direction  source-pmd 

&optional  dest-pmd 
4koy  border-pmd) 

(*lot  (  (dost-pvar-tomp  (!!  0)) 

(sourco-pvar  (pmd2pvar! !  source-pmd  level))  ) 

(cond  ( (not  border-pmd) 

(*all  (*set  dost-pvar-temp  (!!  0)))) 

(t  (*all  (*set  dest-pvar-temp 

(pmd2pvar! !  border-pmd  level))))) 

(cond  (  (eq  level  0) 
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;  l«val  0  then  ell  processors  enabled 
(*all  (*shift  direction  level  source-pvar  dest-pvar-tenp) )  ) 

(  t  ;  other  levels,  enable  relevant  processors 

(*all  (*when  («! !  *psul- level-number*  (!!  level)) 
(*shift  direction  level  source-pvar 
dest-pvar-temp)  ) ) ) 

) ;end  condition 

; return  tvap  dest-pvar  as  part  of  pmd  (rest  \inchanged) 
(cond  (  (not  dest-pmd) 

(cond  ( (»  level  0) 

(make-pmd! !  :top  (pmd-top! !  source-pmd) 
:leaf  dest-pvar-temp)) 

(t  (make-pmd! !  :top  dest-pvar-temp 

:leaf  (pmd-leaf ! !  source-pmd))))  ) 
(t 

(cond  ( (s  level  0) 

(*all  (setf  (pmd-leaf! !  dest-pmd)  dest-pvar-ten^) 
(setf  (psid-top! !  dest-pmd) 

(pmd-top ! !  source-pmd) ) ) 

dest-pmd) 

(t  (*all  (*set-pmd-let  dest-pmd  source-pmd) ) 
(*when  (=!!  *pmd- level-number*  (!!  level)) 
(*all  (setf  (pmd-top!!  dest-pmd) 

dest-pvar-tmnp) ) ) 

dest-pmd) ) 

)) 

) ; end  let 

);end  shift-level-pmd! ! 


;this  function  will  shift  all  levels  in  the  specified  <direction> 


(*defun  shift -pmd! !  (direction  source-pmd  (optional  dest-pmd 

(key  border-pmd) 

(*let  (  (source-pvar  (pmd-top!!  source-pmd)) 

(dest-pvar  (!!  0)) 

(temp-pmd  (make-pmd! ! ) ) ) 

(*all  (*when  (>!!  *pmd- level-number*  (!!  0)) 

(*shift  direction  1  source-pvar 
dest-pvar) 

(cond  (border-pmd 

(*when  (*! !  dest-pvar  (!!  0)) 

(*set  dest-pvar 
(pmd-top !  !  border-jand) ) ) ) ) 
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(*all  (shift-lttv«l-pmd! !  0  diraction  sourctt-pmd  tanp-pmd 

rbordar-pmd  bordar-pmd) ) 

(cond  (dttst-pind 

(s«tf  (poid-top! !  dest-pmd)  dast-pvar) 

(satf  (pmd-laaf ! !  dast^pmd)  (pnd-laaf ! !  t«iip-pmd) ) ) 
(t 

(satf  (pmd-top!!  temp-pmd)  dest-pvar) 
dast-pmd) ) 

) ) ) ) ;«nd  shift-pmd! ! 
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; f 11« :  top-down . lisp 
;v«rsion:  2.0 


THIS  FILE  CONTAIHS  WHAT  IS  NEEDED  TO  SEND  TOP/DOWN 
COMCDNICATIONS  IN  THE  HYPERCUBE  FORMAT.  OTHER 

SUPPORT  FUNCTIONS  ARE  NEEDED. THEY  MAY  BE  FOUND 
IN  SHIFT-NEWS. LISP  or  PMD-util .LISP 
(o.g.  (*assign-lttv«ls) (resat-pvars) (shift-all! ! . . .) 
(print-iisaga  pvar)  . . . 

(* sand- forward  dim  psourca  pdast) (* sand-backward 
<sama  as  -forward>  ) 

THE  TWO  MAIN  FUNCTIONS: 

(sand-laval-parant-pmd! !  child-laval 

op-to-parform-on-sourca-pvar-and-dast-pvar 
sourca-pvar-on-child-laval 
(optional  dast-pvar-on-parent-laval) 

(sand-laval-child-pmd! !  child-laval 

child-a-b-c-or-d 
sourca-pvar-on-child- level 
(optional  dast-pvar-on-parent-laval) 

(sand-laval-childran-pmd! !  parent-level 

source-pvar- from-parant - level 
dest-pvar-of-children-level) 


this  will  sand  info  from  level  i  to  i-f-l  —  the  parent .  It 
first  travels  along  the  2i'i'l(th)  dimension,  so,  e.g.  if 
we  ware  going  from  level  0  to  level  1,  O's  source-pvar 
would  go  to  I's  dest-pvar (pdest99)  and  2's  source-pvar 
would  go  to  3's  dest-pvar.  When  these  pvars  get  sent  to 
the  next  dim,  they  are  op(d)  with  the  source-pvar  of  the 
resultant  address-the  value  is  put  into  the  resultant 
dest-pvar.  e.g.  O's  source-pvar  gets  op(ed)  with  I's 
source-pvar  and  the  result  gets  put  into  I's  dest-pvar. 
next  the  2i-f2  dimension's  is  travelled  on  (  1  goes  to  3)  . 
third,  backward  on  i  (3  goes  to  3  -  esentially  nothing  happens 
for  level  0)  THE  METHOD:  send  forward  along  dimensions  2i+l 
then  2i't-2  then  backwards  on  dimension  i. 

if  you  can't  send  along  2i-M  or  2i+2  then  you  skip  that 
step-must  do  (and  always  can  do  except  when  1^0)  the  backwards 
on  i.  this  works  for  all  levels. 

'pdest99  is  a  temporary  pvar  needed  when  shifting  information 


;  around.  At  tho  and  of  tho  *lot,  this  pvar  is  rafarancad  so 
;  that  its  valua  will  ba  sant  back  to  tha  calling  function. 

;  This  will  anabla  tha  usar  to  assign  tha  valua  to  whatavar 
;  pvar  sha  wishas. 


(*dafun  sand-laval-parant-pmd! !  (laval  op  sourca-pmd 

(optional  dast-pmd) 

;  if  abla  to  sand  to  laval  abova-*a.g.  if  only  3  levels, 

;  can't  send  to  laval  4 

(cond  (  (>  level  (-  *pind-nuinbar-of- levels*  2) ) 

(format  t  "'^Sd  is  too  high  of  a  laval  to  use."  level)) 
(t 

(*lat  (  (pdast99  (!!  0))  ;only  ten^rary  pvar  needed 
(source-pvar  (pmd2pvar! !  source-pmd  level))  ) 
(*all 

(*when  (or!!  (=! !  *pmd-lovol-nuiiibar*  (!!  level)) 
(sti  (!!  level)  (!!  0))) 

( *send-forward-op 

(+  (*  2  level)  1) 

source-pvar 

pdest99 

op) 

( *sand-f orward-op 

(+  (*  2  level)  2) 
pdest99 
pdest99 
op) 

( *send-backward 

;back  on  i-don't  use  op  because  just  sending  # 

level 

pdest99 

pdest99) 


));end  when  and  all 


;0  out  all  pdest99  except  i+1  level 
(*all  (*when  (/=!  !  *pmd-level-nTjmber*  (!!  (+  level  1) ) ) 

(*set  pdest99  (!!  0))  )) 


)))) 


Now,  send  back  value  for  user  to  assign  to  own  pvar 
(*all  (*when  (=!  !  *pmd-laval-nunibar*  (!!  (+  level  1))) 
(cond  (  (not  dest-^d) 

(pref ! !  pdest99  *pmd-self-address*) ) 
(t  (*set-lavel-pmd-pvar  (+  1  level)  dest-pmd 

pdest99) ) ) ) ) 


;and  *let/true/cond 


45 


•nd  sand-parant ! ! 


sand  tha  avaraga  valua  of  child  to  parant  laval. 


(*dafun  sand-laval-parent-avaraga-poidl !  (  laval  sourca-pmd 

(optional  dast-pmd) 

{*all 

( *lat  ( (temp-^d  (inaka-{»td ! ! ) ) 

(tenp-pvar  ( ! !  0) ) ) 

(*all  (*8at  tamp-pvar  (!!  0))) 

(sand-laval-parent-pmd! !  laval  '+!! 

sourca-pmd 

temp-pmd) 

(*when  (=!!  *pmd-laval-nuiiiber*  (!!  {+  level  1))) 

(*all  (*set-level-pmd-pvar 
(+  level  1) 
temp-pmd 

(round!  !  (/ ! !  (]^d-top!  !  temp-pmd)  ( I  !  4) ) ) ) } ) 

(cond  ( (not  dest-pmd) 
temp-pmd) 

(t  (*set-level-pmd  (+  level  1)  dest-pmd  temp-pmd) 
dest-pmd) ) 

))) 


(*defun  average-pmd! !  (pvar  (optional  dest-pmd) 

(*all 

(*let  ( (temp-pmd  (make-pmd! ! ) ) ) 

(setf  (pmd-leaf ! !  temp-pmd)  pvar) 

(setf  (pmd-top! !  temp-pmd)  pvar) 

(dotimes  (level  (-  *pmd-number-of-levels*  1) ) 
(send-level-parent-average-pmd! ! 
level  temp-pmd  temp-pmd) ) 

(cond  ( (not  dest-pmd) 
temp-pmd) 

(t  (*set-pmd  dest-pmd  temp-pmd) 
dest-pmd) ) ) ) ) 


send  a  particular  child  to  parent  level 


(*defun  send-level-child-pmd! !  (level  child  source-pmd 

(optional  dest-pmd) 
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(*lat  (  (dast-pvar  (!!  0)) 

(sourca-pvar  (pmd2pvar! !  sourca-pmd  laval) ) 
(tao^-pmd  (maka-peul! ! ) )  } 

(*all 

(*whan  (or!!  (»! !  *paid-laval-nuinbar*  (!!  laval) ) 
(-!!  (!!  laval)  (!!  0))) 
(sand-part-cliild2 ! !  child  sourca-pvar 

dast-pvar  laval) )  ) 

;  Now,  sand  back  valua  for  usar  to  assign  to  own  pvar 

(*all  (*whan  (=! !  *paid-laval-nuinbar*  (!!  (+  laval  1))) 

(cond  ( (not  dast-pmd) 

( *sat-laval-pmd-pvar 
(+  laval  1) 
tan^-pmd 
dest-pvar) 
temp-pmd) 

(t  (*sat-laval-pmd-pvar 
(+  1  level) 
dast-pmd 
dast-pvar) ) ) ) ) 

) ) ;end  sand-level-child-pmd! ! 


This  function  sands  a  particular  child  to  its  parant. 

It  is  called  from  the  function : sand-particular-child ! ! . 

All  of  the  children  need  to  be  sent  backward  along  the  i (th) 
dimension  after  the  following  steps  are  taken: 

child  'a'  needs  to  send-forward  on  each  dimension, 
child  'b'  needs  to  send  along  the  2x+2, 
child  ' c'  needs  to  send  along  the  2i+l  dimension, 
child  'd'  doesn't  nee'  any  subsequent  send. 


(*dafun  send-part-child2 ! !  (child  source  dest  level) 

;  if  the  child  was  b  or  d,  then  dest  needs  to  be  set  to  source 
;  so  that  the  send  functions  will  work  for  each  child 
;  generically . 

;  (otherwise  the  sendforward  would  go  from  dest  to  source  and 
;  destsnil 

(if  (member  child  ' (b  d) ) 

(*set  dest  source)) 

;  if  the  child  is  'a  or  'c,  then  need  to  send  along  the 
;  2i+l  dimension  no  other  child  needs  to  travel  this  time. 

(if  (member  child  ' (a  c) ) 

(* send- forward  (+  {*2  level)  1)  source  dest)  ) 
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(if  (uMinbar  child  '  {a.  h)) 

(*sand-fonrard  (*>■  (*  2  level)  2)  dest  dest) ) 

(*send-bec]cwerd  level  dest  dest) 

;send  back  no  matter  which  child 

) ;end  send-part-child2 ! ! 


used  for  adding  operation  for  send- level-parent 

this  is  just  an  op  to  be  used  when  sending  parallel  along 

a  dimension.  This,  obviously /  adds  two  pvars. 


(*defun  *add2  (px  py) 
(+! !  px  py) ) 


from  i+1  to  i 

this  will  send  the  value  in  the  parent  processor  'level' 
: (level  i+l)  to  all  of  ;  its  children  (level  i) 
the  parameters:  level  =>  parent  level  sending  from 

source-pvar  =  pvar  in  parent  level  to  send  down 


(*defun  send-level-children-pmd! !  (level  source-{mid 
fioptional  dest-pmd) 

(*all 

(*when  (or!!  (=! !  *pmd-level -number*  (!!  level)) 

;turn  on  parent  level  to  send  from 
;turn  on  level  to  send  to  -  children 
(si !  *pnd- level-number*  (!!  (-  level  1))) 

(si !  (!!  level)  (!!  1))  ) ;end  'or 

(*let  (  (pdest99  (!!  0))  ;only  temp  pvar  to  use 

(source-pvar  (pmd2pvar! !  source-pmd  level))  ) 
( *send-forward 

(-  level  1)  /forward  i (level-1)  from  i+1 (level) 
source-pvar 
pdest99) 

( *send-backward 

(+  (*  2  (-  level  D)  2)  /2i+2 

pdest99 

pdest99) 

( *  send-backward 

(+1  (*  2  (-  level  1)))  ;2i+l 
pdest99 
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pda8t99) 


(*all 

(*wh«n  (or!!  (-! !  (!!  lovol)  (!!  1)) 

(a!!  Apmd-lovol-nunbor*  (!!  (-  lovol  1)))) 
(cond  (  (not  dost-pind) 

(prof!!  pdest99  *Fnd-solf-addross*) ) 

(t  (*s«t-levol-Find-pvar  (-  lavol  1)  dost-pmd 

pdost99) ) ) ) ) 

) ) ) ) ;ond  send-lavol-children ! ! 
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fil«:  pmd-dlsplay . lisp 
▼•rslon :  2.0 


routine  for  display  values  of  a  certain  level 
(note:  uses  routines  in  cube-grid. lisp) 

this  function  returns  a  pvar  which  is  set  to  the  x-coordinate 
of  the  grid-address  for  the  PE  on  the  specified  level  -  this 
pvar  should  be  indexed  by  its  grid-address  which  represents 
the  x,y  coordinates  of  the  node  on  the  level 


(*defun  level-to-grid-x ! !  (ilevel) 

-!!  (-!!  (*!!  (+!!  (!!  1)  (self-address-grid!!  (!!  1) ) ) 

( ! !  (expt  2  ilevel) ) ) 

(!!  D) 

(cube2col! !  ( ! !  (-  (expt  2  (-  ilevel  1) )  1) ) ) ) ) 


this  function  returns  a  pvar  which  is  set  to  the  y-coordinate 
of  the  grid-address  for  the  PE  on  the  specified  level  -  this 
pvar  should  be  indexed  by  its  grid- address  which  represents 
the  x^y  coordinates  of  the  node  on  the  level 


(*defun  level-to-grid-y ! !  (ilevel) 

(-!!  (-!!  (*!!  (+!!  (!!  1)  (self-address-grid! !  (!!  0) ) ) 

( ! !  (expt  2  ilevel) ) ) 

(!!  D) 

(cube2row! !  (!!  (-  (expt  2  (-  ilevel  1))  1)}))) 


returns  pvar  which  when  grid-addressed  by  x, y  will  return 
the  cube-address  of  the  PE  whose  location  on  the  specified 
level  is  x, y 


(*defun  level-c\ibe! !  (ilevel) 

(cond  ( (=  ilevel  0) 

(rowcol2cube! !  (self-address-grid! !  (! !  0) ) 

(self-address-grid! !  ( ! !  1) ) ) ) 

(t  (rowcol2cube! !  (level-to-grid-y!!  ilevel) 

(level-to-grid-x! !  ilevel) ) ) ) ) 


display  the  specified  values  for  the  specified  level  in  grid 
format . 


(*defun  *display-level-pmd  (fmid  ilevel) 
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(*all 

(Ittt  ( (laval-grldsiztt  (axpt  2  (-  *Find-nuaib«r-of-lavttls* 

(1+  ilaval))))) 

(*l«t  ( (pl«vttl-cub«  (l«v«l**cub«! !  llaval)) 

(p-value  (pmd2pvar! !  pad  ilaval) ) ) 

(tarprl) 

;  for  oach  pa  on  this  laval  (in  rastar  scan  ordar) 

(dotlmas  (x  laval -gridslza) 

(dotimas  (y  laval-gridsiza) 

(format  T  "«"6d  " 

;  glvan  "laval"  grid-address  -  rafaranca  p-valua 
;  by  first  determining  its  cuba-addrass 

(praf  p-valua  (praf-grid  plevel-cuba  x  y) ) ) ) 
(tarpri) ) ) ) ) ) 


display  all  levels  of  a  pyramid 


(*dafun  *display-pmd  (pmd) 

(dotimas  (ilaval  *pmd-numbar-of- levels*) 
(format  t  "~%  Laval  -2d  :  -%"  ilaval) 
(*display-level-pmd  pnd  ilaval))) 


(*dafun  *display-pmd-part  (pmd  start-level  end-level) 

(do  ((ilavel  start-level  (+  ilaval  1))) 

( (s  ilaval  (+  and-laval  1) ) ) 

(format  t  "-%  Level  -2d  :  -%"  ilevel) 

(cond  ( (>  ilevel  3) 

(*display-level-pmd  pmd  ilevel)) 

(t  (*display-level-pmd-part  pmd  ilevel  10))))) 


(*dafun  *display-leval-pmd-part  (pmd  ilevel  size) 

(*all 

(let  ( (level-gridsize  (expt  2 

(-  *pmd-nuxnber-of- levels*  (1+  ilevel))))) 
(*let  ( (plaval-cuba  (level-cube!!  ilevel)) 

(p-value  (pmd2pvar! !  pmd  ilevel))) 

(terpri) 

(cond  ( (<  ilevel  4) 

(setq  level-gridsize  size))) 

(dotimes  (x  level-gridsize) 

(dotimes  (y  level-gridsize) 

(format  T  "-6d  " 

(praf  p-value  (pref-grid  plevel-cube  x  y) ) ) ) 
(terpri) ) ) ) ) ) 
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f il« :  cubtt-grid . lap 


parallal  routlnas  for  convarting  cub«  addrassaa  to  row  and 
coluam  and  vica  varaa 


(*dafun 

(*lat 

(do 


cuba2row! !  (pcuba) 

((prow  (!!  0))) 

((i  15  (-12)))  ((=  i  -1)  prow) 

(*sat  prow  (daposit-byta! !  prow  (!!  (/  (-11)  2))  (!!  1) 

(load-byta!!  pcuba  (!!  1)  (!!  1))))))) 


(*dafun 

(*lat 

(do 


cuba2col!!  (pcuba) 

((pcol  (!!  0))) 

((1  14  (-12)))  ((=1  -2)  pcol) 

(*sat  pcol  (daposlt-byta! !  pcol  (!!  (/  1  2) )  (!!  1) 
(load-byta!!  pcuba  (!!  1)  (!!  1))))))) 


(*dafun  row2cuba! !  (prow) 

(*lat  ((pcuba  (!!  0))) 

(do  ((1  15  (-12)))  ((»  1  -1)  pcuba) 

(*aat  pcuba  (daposlt-byta!!  pcuba  (!!  1)  (!!  1) 

(load-byta!!  prow  (!!  (/  (-11)  2))  (!!  1))))))) 

(*da£un  col2cuba! !  (pcol) 

(*lat  ((pcuba  (!!  0))) 

(do  ((1  14  (-12)))  ((=1  -2)  pcuba) 

(*sat  pcxiba  (daposlt-byta!!  pcuba  (!!!)  (!!!) 

(load-byta!!  pcol  (!!  (/  1  2))  (!!  1))))))) 

(*da£\in  rowcol2cuba! !  (prow  pcol) 

(+!!  (row2cuba! !  prow)  (col2cuba! !  pcol))) 
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fil« 


pad-conv .  lisp 


fianctions:  to  do  tho  convolution  for  pmd. 

1.  for  a  apacial  laval 

2.  for  all  lavals  togatbar 


this  function  will  do  tha  convolution  for  a  user's  specified 
laval  of  a  pyramid  using  a  given  maslc. 

input  :  pmd-  a  parymid 

laval-  a  number  to  indicate  tha  level  user  want 
mask-  the  mask  for  convolution 
m,  n-  the  size  of  the  mask 

return:  the  user  specified  level  of  the  input  pmd  get  the 
result  of  the  convolution  with  tha  given  mask 

this  function  uses  the  functions  in  shift-news . lisp  file . 
according  to  the  mask' s  size,  it  do  the  convolution  in 
the  order:  downward,  rightward,  upward,  and  leftward  as 
a  cycle,  it  does  cycle  by  cycle  until  finish  the  number 
of  steps  ,  which  is  m*n. 


(*defun  |»id-conv-level! !  (pmd  level  mask  m  n 

&optional  dest-pmd) 


(*all 

(*lat  ( (pmd-temp  (make-pmd! ! ) ) 

(pmd-copy  (make-pmd! ! ) ) ) 


(let  ( (sum  (sumarray  mask  m  n  } ) 
(done  (*  m  n) ) ) 


(*set-level-pmd-pvar  level  pmd-temp  (*!!  (pmd2pvar! !  pmd  level) 

(!!  (aref  mask  0  0)))) 


(*coii^ute-conv  pmd-temp  pmd-copy  pmd  level  mask  m  n  done  ) 

)  ;end  of  let 
(cond  ( (not  dest-pmd) 
pmd-temp) 

(t 

(*set-level-pmd  level  dest-^d  pmd-temp) 
dest-pmd) ) 

)  ;end  *let. 
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));«nd  of  tlx«  function. 


it  roturns  tlia  sum  of  an  array 
input:  arr  is  an  array 

m,n  ara  tha  siza  of  tha  array 


(dafun  sumarray(arr  m  n) 

(lat  ((sum  0)) 

(do  ( (tampl  0  (t  tempi  1) ) ) 

( (s  tampl  m  )  sum) 

(do  ( (tamp2  0  temp2  1) ) ) 

( (s  t«np2  n  )  ) 

(satq  sum  (-f  sum  (araf  arr  tampl  temp2) )))))) 


gats  tha  convolution  value  for  a  pmd 


(*daftui  *coatpute-conv  (pmd-temp  pmd-copy  pmd  level  mask  m  n  done) 
(let  ( (xstart  0) 

(xend  (-ml)) 

(ystart  0  ) 

(yend  (-  n  1))) 

(do  ((count  1))  ;for  one  circle. 

( (=  count  done) ) 

(do  ( (x  xstart)  ;for  downward,  shift  south 

(y  ystart  (+  y  1))) 

( (or  (s  y  yend  )  (=  count  done) ) ) 

( shift- level-pmd ! !  level  's  pmd-temp  pmd-copy 

:border-pmd  pmd-temp) 
(*set-level-pmd-pvar  level  pmd-temp 

(*!!  (pmd2pvar! !  pmd  level) 

( ! !  (aref  mask  x  (-•■  y  1) ) ) ) ) 
(*set-level-pmd-pvar  level  pmd-temp 

(t!!  (pmd2pvar! !  pmd-temp  level) 

(^d2pvar! !  pmd-copy  level) ) ) 

(setq  count  (+  count  1) ) ) 

(if  (/*  ystart  0)  (setq  ystart  (+  ystart  1))) 


(do  ( (y  yend)  ;for  rightward,  shift  east 

(x  xstart  (-f  X  1) ) ) 

( (or  (-  X  xend)  (=:  coiint  done) ) ) 
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(shift-lttvttl-pnd! !  l«v«l  pmd-tonp  pmd-copy 

:bord«r-pmd  pmd-’teii^) 
(*s«t-l«vttl-piBd-pvar  pmd-tainp 

(*!!  (piiuUpvar! !  pmd  laval) 

(!!  <araf  mask  (+  x  1)  y) ) ) ) 

(*8at-laval-paid-pvar  laval  pmd-tttnp 

(+!!  (pmd2pvar! !  pmd-temp  laval) 

(pmd2pvar! !  pmd-copy  laval) ) ) 

(satq  count  (+  count  1))) 

(do  ( (x  xand)  ;for  upward,  shift  north 

(y  yand  (-  y  1))) 

( (or  (s  y  ystart)  (»:  count  dona) ) ) 

(shift-laval-pmd!  !  laval  'n  pmd-temp  ^d-copy 

:bordar-pmd  pmd-temp) 
(*sat-laval-paui-pvar  laval  pmd-temp 

(*!!  (pmd2pvar! !  pmd  level) 

(!!  (aref  mask  x  (-  y  1))))) 

(*set-level-pmd-pvar  level  pmd-temp 

(+! !  (pmd2pvar! !  pmd-temp  laval) 
(pnd2pvar!  !  ][»id-copy  level))) 

(satq  count  count  1) ) ) 

'  (do  ( (y  ystart  )  ; for  leftward,  shift  west 

(x  xand  (-  x  1) ) ) 

( (or  (~  X  (■•■  xstart  1) )  (=  count  done) ) ) 
(shift-level-pmd! !  level  'w  pmd-temp  pmd-copy 

:border-pmd  pmd-temp) 
(*sat-level-pmd-pvar  laval  pmd-temp 

(*!!  (pmd2pvar! !  pmd  level) 

(!!  (aref  mask  (-  x  1)  y) ) ) ) 

(*set-leval-pmd-pvar  level  pmd-temp 

(■f!!  (pmd2pvar!  !  {snd-temp  level) 

(pmd2pvar! !  pmd-copy  level))) 

(satq  count  (+  count  1))) 

(satq  xstart  (-!•  xstart  1))  ;sat  up  the  condition  for 

(satq  xand  (-  xand  1))  ;next  circle. 

(satq  yand  (-  yand  1)) 

)  ;and  of  do  loop 
) ;  and  of  let 

) 
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;  this  function  will  do  tho  convolution  for  all  tho  lavals  of  a 
;  pyranid  using  a  givan  mask. 


input  :  pmd-  a  pyramid 

mask-  tha  mask  for  convolution 
m,  n-  tha  siza  of  tha  mask 

ratum:  all  tha  lavals  of  tha  input  pmd  gat  the  result  of 
tha  convolution  with  tha  givan  mask 


(*dafun  pmd-conv! !  (pmd  mask  m  n  (optional  dest-pmd) 

(*all 

(*lat  ( (tamp-poid  (maka-pmd! ! ) ) ) 

(do  ( (x  (-  *pind-numbar-of- lavals*  1)  (-  x  1) ) ) 

((<  X  0)) 

(* set -level -pmd  x 

temp-pmd 

(pmd-conv- level ! !  pmd  x  mask  m  n) ) 


) 

(cond  ( (not  dest-fxnd) 
temp-pmd) 

(t 

(*set-pmd  dest-pmd  temp-pmd) 
dest-pmd) ) 
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Fila  nama:  maka-mask . lisp 
■aka  sooa  arrays. 


(satq  gaussian  (maka-array  '(33)  : initial-contants 

'((1  2  1)  (2  4  2)  (1  2  1)))) 

(satq  laplacianl  (maka-array  '(33)  : initial-contents 

' ((0  1  0)  (1  -4  1)  (0  1  0)))) 

(satq  laplacian2  (maka-array  '(33)  .'initial-contents 

'((1/4  1/2  1/4)  (1/2  -3  1/2)  (1/4  1/2  1/4)))) 

(satq  arr  (maka-array  '(33)  : initial-contents 

'((111)  (111)  (111)))) 
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filtt  :  poul-prof .  lisp 


this  function  roturns  a  valuo  from  a  pyrainid-  pmd 
at  a  spacific  laval-  laval  at  location  x  and  y. 


(dafun  praf-grid-laval-poid  (pmd  laval  x  y) 

(*all 

(lat  ( (laval-gridsiza  (axpt  2 

Apnd-nuinbar-of-lavals*  (1+  level))))) 

(*let  ( (plevel-cube  (level-cube!!  level)) 

(p- value  (pmd2pvar!!  pmd  level))) 

(cond  ( (and  (>=  x  0)  (<  x  level-gridsize) 

(>«  y  0)  (<  y  level -gridsize) ) 

(pref  p-valua  (pref-grid  plevel-cuba  x  y) ) ) 
(t  (format  t  "  x  or  y  out  of  range"))) 

)))) 


this  function  returns  a  pyramid,  in  which,  at  level-  level, 
each  pixel  contains  the  value  from  original  pyramid-  pmd  at 
relative  location  (rx,zy) 


(*defun  pref-grid-level-pmd-relative ! !  (pmd  level  rx  ry) 
(*all 

(*let  ( (tamp-pmd  (make-pmd! ! ) ) ) 

(let  ((tx  0)  (dx  0) 

(ty  0)  (dy  0)) 

(cond  ( (>  rx  0)  (setq  tx  (-  rx  1))  (setq  dx  1)) 

(t  (setq  tx  (-  1  rx) )  (setq  dx  0))) 

(cond  ( (>  ry  0)  (setq  ty  ry)  (setq  dy  1)) 

(t  (setq  ty  (-  0  ry))  (setq  dy  0))) 

(cond  ( (s  dx  1) 

( shift- level-pmd ! !  level  'w  ^d  temp-pmd) ) 

(t  (shift-level-pmd! !  level  'b  pmd  temp-pmd))) 

(dotimes  (x  tx) 

(cond  ( (-  dx  1) 

(shift-level-pmd!!  level  'w  temp-pmd  temp-pmd)) 

(t  (shift-level-pmd!!  level  'e  temp-pmd  temp-pmd)))) 

(dotimes  (y  ty) 

(cond  ((3:  dy  1) 

(shift-level-pmd!!  level  'n  temp-pmd  temp-pmd)) 

(t  (shift-level-pmd!!  level  's  temp-pmd  temp-pmd)))) 

temp-pmd) ) ) ) 
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f iltt :  pmd-edges . lisp 


input:  start-level — >  a  level  to  start  to  find  edges  in  pmd 
thresh  — >  a  thresh  value  for  the  pmd 
pmd  — >  a  pyramid  to  find  its  edges 

dest-pmd  — >  a  pyramid  to  record  the  edges  of  pmd. 
returns :  a  pyramid  recording  the  edges . 


(*defun  edges-pmd! !  (start-level  thresh  pmd  &optional  dest-pmd) 
(*let  (  (parent -pmd  (make-pmd! ! ) ) 

(edge-pmd  (make-pmd! ! ) ) ) 

;  start  out  by  setting  parent-value  to  threshold  so  all 

;  edges  will  be  calculated  for  the  start  level 

(*set-level-pmd-pvar  start-level  parent-pmd  (!!  thresh)) 

(refine  pmd  start-level  parent-pmd  edge-pmd  thresh) 

(cond  ( (not  dest-pmd) 
edge-pmd) 

(t 

(*all  (*set-pmd-let  dest-pmd  edge-pmd)))) 

) ) ;end  *find-edges 


This  function  will  recursively  go  down  the  pyramid  from 
start-level  to  the  0th  level.  At  each  level,  if  the  parent's 
value  was  above  the  threshold,  it  calculates  the  edge  value 
for  each  pixel  (on  that  level)  and  stores  this  value  in  the 
temporary  pmd  'edge. 


(*defun  refine  (pmd  level  parent  edge  thresh) 

(*all  (*when  (and!!  (=! !  (!!  level)  *pmd- level-number*) 
(>»! !  (pmd2pvar! !  parent  level)  (!!  thresh))) 
(*set-level-pmd-pvar  level  edge  (edge-op!!  pmd  level)))) 

;  As  long  as  you  haven't  reached  the  0th  level,  keep  refining 
;  Refine  by  setting  the  parent-value  of  children  to  edge  value 
;  of  current  level 

(cond  (  (/s  level  0) 

(*all 

(send-level-children-pmd! !  level  edge  parent) 
(refine  pmd  (-  level  1)  parent  edge  thresh) )  ) 

(t  't)) 
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tills  will  calculsta  (A  -  B)  ^2 


(X  -  Y)^2  whore: 


;  •* - 

1  r 

1 

B 

;  1  A 

1 

X 

r  ^  ^ 

r 

(*defan  edge-op! ! 

(^d 

level) 

(*all 

(*let  (  (teo^-pvarl  (M  0)) 

(temp-pvar2  ( ! !  0 ) )  ) 

(*all  (*when  (=! '.  *pmd- level-number*  (!!  level)) 

(*shi£t  'a  level  (pmd2pvar! !  pmd  level) 
temp-pvarl) ) ) 


(*all  (*set  temp-pvar2  temp-pvarl) ) 

;  First  set  temp-pvarl  to  start  value  -  value  from 
;  north  and  east . (A-B) 

(*all  (*when  (=! !  *pmd- level-number*  (!!  level)) 
(*shift  'w  level  temp-pvarl 
temp-pvarl) ) ) 

(*all  (*set  temp-pvarl 

(-!!  (pmd2pvar! !  pmd  level)  temp-pvarl))) 


;  Second  set  temp-pvar2  to  start  value  -  value  from 
;  north  and  west. (X-Y) 

(*all  (*when  (=! !  *pmd-level-number*  (!!  level}) 
(*shift  'e  level  temp-pvar2 
temp-pvar2) ) ) 

(*all  (*set  temp-pvar2 

(-!!  (pmd2pvar! !  pmd  level)  temp-pvar2) ) ) 


/send  back  this  value. . .  (A-B-let)  ^2  +  (X-Y)  ^^2 

(*all  (*when  (=! !  *pmd- level-number*  (!!  level)) 

(* shift  'w  level  (*!*  t6mp-pvar2  temp-pvar2) 
tfflnp-pvar2 ) ) ) 


(*all  (*set 

temp-pvarl 

(+! !  (*!!  temp-pvarl  temp-pvarl) 

temp-pvar2) ) ) 

(*all  (pref ! !  temp-pvarl  *pmd-self-address*) ) 
) ) ) ; end  edge-op ! ! 
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file:  pmd- load. lisp 

routines  for  loading  images  (UT  formatted  files) 
into  pvars  (via  2-d  array  -  need  machine  configuration 
to  be  at  least  as  large  as  this  array) 

-  see  also  unload. lisp 

returns  pvar  which  contains  isiage  data 


(defun  read-file-pmd! !  (file-top  file-leaf  ^optional  dest-pmd) 
(*all 

(*let  ( (  temp-pmd  (make-pmd! ! ) ) ) 

(cond  ( (not  dest-pmd) 

(setf  (pmd-top!!  temp-pmd) 

(read-file-pvar ! !  file-name) ) 

(setf  (pmd- leaf!!  temp-pmd) 

(read-file-pvar! !  file-name) ) 
temp-pmd) 

(t 

(setf  (^d-top! !  dest-pmd) 

(read-file-pvar! !  file-name) ) 

(setf  (pmd-leaf ! !  dest-pmd) 

(read-file-pvar! !  file-name) ) 
dest-pmd) ) 

))) 


(defun  read-file-pvar! !  (file-name  fioptional  dest-pvar) 

;  Open  file  for  reading  bytes,  if  file 
;  doesn't  exit  returns  nil 
(setq  port  (open  file-name 

: direction  : input 
: element-type  ' (unsigned-byte  8) 
:if-does-not-exist  nil)) 

(cond  (  (eq  nil  port)  (print  "file  not  opened-does  not 

exist") (terpri) ) 

(t  (print  "file  opened")  (terpri) 

;  lop-off -header  will  send  back  the  dimensions  of  the  image 
;  this  info  is  given  in  the  header  of  the  file 

(lop-off -header  port); sets  dimension-row  & 

;  dimension-col 
(cond  ( (not  dest-pvar) 

(read-file2  port  dimension-row  dimension-col) ) 

(t  (*set  dest-pvar 

(read-file2  pozrt  dimension-row  dimension-col) ) 
dest-pvar) ) 


))) 
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;  rMd  iinags  data  from  fila  aad  put  into  global  array  imago 
(dofun  road-file2  (port  dim-row  dim-col) 

(cond  ( (or  (>  dim-row  (dimonsion-sizo  0) ) 

(>  dim-col  (dimonaion-sizo  1) ) ) 

(print  "Image  too  large  for  given  machine  size")) 

(t 

(let  ( (image  (make-array  (cons  (dimension-size  0) 

(list  (dimension-size  1))) 

: initial-element  0) ) ) 

(do  (  (y  0  (+  y  1))  ) 

(  (*  y  dim-row)  't) 

(do  (  (X  0  (+  X  1))  ) 

(  (=  X  dim-col)  't) 

(setf  (aref  image  x  y) 

(read-byte  port  nil  'eof)  ) 

) ;end  do  x 
) ;end  do  y 
(close  port) 

(array-to-pvar-grid  image) ))); end  let,t  &  cond 
) ;end  read-file2 

(defun  lop-off-header  (port) 

;  The  dimensions  of  the  image  are  :1st  byte 

;  +  256*2nd  byte=#  of  rows  :3rd  byte  +  256*4th  byte=#of  cols 
(setq  dimens ion- row  (+  (read-byte  port) 

(*  256  (read-byte  port))));#of  rows 
(setq  dimension-col  (+  (read-byte  port) 

(*  256  (read-byte  port))));#of  cols 
;then  there  are  507  bytes  worth  of  junk 
(do  (  (x  0  (+  1  x) ) )  ;inits 

(  (=  X  507)  't)  ;until  end. send  back  't 
(read-byte  port) ) /throw  away 
/last  (or  512th  b3^e)  is  type  of  image  it  is 
/(setq  type-of-image  'c) 

(setq  type-of-image  (read-byte  port)) 

(format  t 

"the  type  of  picture  is  -c"  (int-char  type-of-image) ) 
)/end  lop-off-header 


(*defun  pg(x)  (ppp  x  :mode  :grid)) 

(defun  pa (a  n  m) 

(do  ((j  0  (+  j  1)))  ((=  j  n)) 

(do  ((k  0  (+  k  1)))  ((=  k  m)) 

(format  t  "-3d  "  (aref  a  j  k) ) ) 

(format  t  "-%"))) 

(*defun  *load-level  (source-pvar  dest-pvar  ilevel) 

(*all  (*load-level2  source-pvar  dest-pvar  ilevel))) 
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(*d«fun  *load-Ittvel2  (sourca-pvar  dast-pvar  ilaval) 

(lat  (  (laval-gridalze  (aapt  2  (-  ntim-lavals  ilaval) ) ) ) 

(*lat  ( (pXaval-ciaba  (laval-cuba! !  ilaval))) 

(dotimaa  (x  laval'-gridsiza) 

(dotimaa  (y  laval-grldsize) 

(satf  (praf  dast-pvar  (praf-grid  plevel-cuba  x  y) ) 
(praf-grid  source-pvar  x  y) ) ) ) 

) ) ) ;and  load-level2 
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fila:  unload . lisp 

routinas  for  unloading  a  pvar  into  an  imaga  fila 
(UT  format) 

ratums  nil  if  fila  mada  proparly 


(dafun  writa-fila-pmd  (pmd  file-top  file-leaf  row-size  col-siza) 
(*all 

(write- fila-pvar  (poid-top!!  pmd) 
file-top  row-size  col-siza) 

(writa-file-pvar  (pmd- leaf ! !  pmd) 
file-leaf  row-siza  col-siza) 

)) 


(defun  write-file-pvar  (p-img  file-name  row-size  col-size) 

;  open  file  for  writing  bytes,  if  file  already  exists  then  new 
;  file  will  have  larger  version  number  (p420) 

;  closes  file  automatically  at  function  end 
(setq  port  (open  file-name 

: direction  : output 
: element-type  '(unsigned-byte  8))) 

(cond  (  (eq  nil  port)  (print  "file  not  opened-does  not 

exist”) (terpri) ) 

(t  (print  "file  opened")  (terpri) 

;  write  header  to  file 

(write-header  pozrt  row-size  col-size) 

;  write  image  data  to  file 

(write-file2  port  p-img  row-size  col-size) 

) ) )  ;  end  of  write-file 


;  write  image  data  from  file  and  put  into  global  array  image 
(defun  write-file2  (port  p-img  row-size  col-size) 

(let  ((ima^a  (make-array  (cons  row-size  (list  col-size))))) 
(pvar-to-array-grid  p-img  image) 

(do  (  (y  0  (+  y  D)  ) 

(  (=  y  row-size)  't) 

(do  (  (X  0  (+  X  D)  ) 

(  (=  X  col-size)  't) 

(satf  (aref  image  x  y) 

(write-byte  (aref  image  x  y)  port)  ) 

) ; end  do  x 
) ;end  do  y 
(close  port) 

) ) ;end  write-file2 
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(d«fun  wrlt^-hsadar  (port  row-siz«  col-sizo) 

;th«  dlniAnsions  of  tho  Imago  arorlst  byta 
;  -f  256*2nd  bytOB#  of  rows 

;  :3rd  byta  256*4th  byta«#of  cols 

(writa-byta  (mod  row-siza  256)  port) 

;  Isb  of  rowsiza 

(writa-byta  (floor  (/  row-siza  256) )  port) 

;  msb  of  rowsiza 

(writa-byta  (mod  col-siza  256)  port) 

;  Isb  of  colsiza 

(writa-byta  (floor  (/  col-size  256) )  port) 

;  msb  of  colsiza 

;tban  thara  ara  507  bytes  worth  of  junk 
(do  (  (x  0  (*>■  1  x) ) )  ;inits 

(  (»  X  507)  't)  /until  and. sand  back  't 
(writa-byta  0  port) ) /throw  away 
/last  (or  512th  byta)  is  type  of  image  it  is  (byte  image) 
(write-byte  (char-int  #\b)  port) 

) /end  write-header 
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f ila :  pad-init . lisp 


This  is  ay  fils  for  initializing  the  anvironmont  for 
tasting  tha  pyramid  amulation 


(dafun  tast() 

(load  "pyramid-amulata . lisp" ) 
(pyramid-OBulato  ) 

) 


(dafun  init() 

(*dafpmd  pi) 

(*dafpiad  p2) 

(*defpiiid  p3) 

( *dafpmd  p4  ) 

(*dafpmd  p5  ) 

(*dafvar  self  ( sal f -address !!) ) 

(*defvar  al) 

(*all  (*sat  al  (if!!  (>! !  self  (!!  8200)) 

(!!  255) 

(!!  0)))) 

(*set-pmd-pvar  pi  al) 

( *set-pmd-pvar  p4  self) 

(*set-pmd-pvar  p5  ( as sign- levels !!) ) 


;;;  Lucid  Common  Lisp,  Development  Environment  Version  2.1, 

; ; ;  6  December  1987 

; ; ;  Copyright  (C)  1987  by  Lucid,  Inc.  All  Rights  Reserved 

f  t  t 

; ; ;  This  software  product  contains  confidential  and  trade  secret 
; ; ;  information  belonging  to  Lucid,  Inc .  It  may  not  be  copied 
; ; ;  for  any  reason  other  than  for  archival  and  backup  purposes 
; ; ;  Connection  Machine  Software,  Release  4.3 

t  9  9 

; ; ;  Copyright  (C)  1988  by  Thinking  Machines  Corporation . 

;;;  All  rights  reserved. 

>  (in-package  ' *lisp) 

«<Package  "*LISP"  A07023> 

>  (cm .'attach  :16k) 

; ; ;  Loading  source  file  "/usr/local/etc/cm_configuration.lisp" 

Warning:  If  you  are  using  *Lisp,  you  must  now  do  *COLD-BOOT. 

16384 

>  (*cold-boot  : initial-dimension  '(128  128)) 
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Loading  microcoda  functions  fila 

"/usr/local/lib/cm/microcoda-bata-f4305/PARIS-l-l-UCODE-FOBMS" 

.  .  .  Dona. 

Loading  microcoda  ucoda  control  stora  fila 

” /usr / local /lib/ cm/aicrocoda-bata- f 4 3 0 5 /PARI S - 1 - 1 -OCODE-CS . CS " 

.  .  .  Dona . 

; ; ;  Ejcpanding  Dynamic  Mamory 
T 

>  (load  "pyramid-emulata.lisp”) 

; ; ;  Loading  sourca  file  "pyramid-amulata . lisp" 

; ; ;  Expanding  Reserved  Memory 

;;;  GC:  417452  words  [1669808  bytes]  of  dynamic  storage  in  use. 

; ; ;  580946  words  [2323784  bytes]  of  free  storage  available 
; ; ;  before  a  GC . 

;;;  1579344  words  [6317376  bytes]  of  free  storage  availaible  if 
;;;  GC  is  disabled.  Expanding  Reserved  Memory 

;;;  GC:  417452  words  [1669808  bytes]  of  dynamic  storage  in  use. 

; ; ;  580946  words  [2323784  bytes]  of  free  storage  available 
; ; ;  before  a  GC . 

;;;  1579344  words  [6317376  bytes]  of  free  storage  available 
; ; ;  if  GC  is  disabled . 

;;;  GC:  417452  words  [1669808  bytes]  of  dynamic  storage  in  use. 
;;;  580946  words  [2323784  bytes]  of  free  storage  available  before 
; ; ;  a  GC . 

;;;  1579344  words  [6317376  bytes]  of  free  storage  available  if  GC 
; ; ;  is  disabled . 

; ; ;  While  compiling  PSET-PMD-TOP 

;;;  Warning:  No  source  code  is  available  for  inline  expansion  of 
;;;  call  to  *LISP-I::NEQ 

#P " /ul /Columbia/ Ibrown/ju/pyramid/pyramid-emulate . lisp" 

>  (pyramid-emulate) 


****  Pyramid  Emulation  ***** 
—  version  1.0  — 


T 

>  (*defpmd  pi  (pmd! !  1) ) 

PI 

>  (*defpmd  p2  (pmd!!  0)) 

P2 

>  (*defpmd  p3) 

P3 

>  (*set-pmd-pvar  p3  ( self -address !!) ) 
NIL 

>  ( *def pmd  p4 ) 
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P4 


>  (*s«t-pind’*pvar  p4 

(assign- 

lavals ! ! 

)) 

NIL 

>  (*dlsplay-paid-part 

p3  4  7) 

L«v«l 

4  : 

248 

504 

1272 

1528 

4344 

4600 

5368 

5624 

760 

1016 

1784 

2040 

4856 

5112 

5880 

6136 

2296 

2552 

3320 

3576 

6392 

6648 

7416 

7672 

2808 

3064 

3832 

4088 

6904 

7160 

7928 

8184 

8440 

8696 

9464 

9720 

12536 

12792 

13560 

13816 

8952 

9208 

9976 

10232 

13048 

13304 

14072 

14328 

10488 

10744 

11512 

11768 

14584 

14840 

15608 

15864 

11000 

11256 

12024 

12280 

15096 

15352 

16120 

16376 

Laval 

5  : 

1008 

2032 

5104 

6128 

3056 

4080 

7152 

8176 

i 

9200 

10224 

13296 

14320 

11248 

12272 

15344 

16368 

Laval 

6  : 

4064 

8160 

12256 

16352 

Laval 

7  : 

16320 

■i 

NIL 

>  ( *display-pncl-part 

p4  4  7) 

Laval 

4  : 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

Laval 

5  : 

5 

5 

5 

5 

5 

5 

5 

5 
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5  5  5  5 

5  5  5  5 

L«v«l  6  : 

6  6 

6  6 

Level  7  : 

7 

NIL 


>  (shift 

-level-pmd! ! 

4  'n  p4 

pi  :border-pmd  p3) 

#<6ENSRAL-Pvar 

PI  63739-222> 

>  (*display-level-pmd  pi  4) 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

4 

8440 

8696 

9464 

9720 

12536 

12792 

13560 

13816 

NIL 

>  (shift 

1 

1 

9 

H 

1 

4  'n  p3 

Pl) 

#<GENERAL-Pvar 

PI  63739-222> 

>  (*display-level-pmd  pi  4) 

760 

1016 

1784 

2040 

4856 

5112 

5880 

6136 

2296 

2552 

3320 

3576 

6392 

6648 

7416 

7672 

2808 

3064 

3832 

4088 

6904 

7160 

7928 

8184 

8440 

8696 

9464 

9720 

12536 

12792 

13560 

13816 

8952 

9208 

9976 

10232 

13048 

13304 

14072 

14328 

10488 

10744 

11512 

11768 

14584 

14840 

15608 

15864 

11000 

11256 

12024 

12280 

15096 

15352 

16120 

16376 

0 

0 

0 

0 

0 

0 

0 

0 

NIL 

>  (pmd-conv-level ! !  p3  4  arr  3  3  pi) 

#<GENERAL-Pvar  PI  63739-222> 

>  (*display-level-pnid  pi  4) 

;;;  GC:  556792  words  [2227168  bytes]  of  dynamic  storage  in  use. 
;;;  441606  words  [1766424  bytes]  of  free  storage  available  before 
; ; ;  a  GC . 

;;;  1440004  words  [5760016  bytes]  of  free  storage  available  if 
;;;  GC  is  disabled. 

57016  56248  60088  71608  81592  93112  96952  79800 

14520  13752  17592  29112  39096  50616  54456  37304 
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22200 

21432 

25272 

36792 

46776 

58296 

62136 

44984 

45240 

44472 

48312 

59832 

69816 

81336 

85176 

68024 

65208 

64440 

68280 

79800 

89784 

101304 

105144 

87992 

88248 

87480 

91320 

102840 

112824 

124344 

128184 

111032 

95928 

95160 

99000 

110520 

120504 

132024 

135864 

118712 

78008 

77240 

81080 

92600 

102584 

114104 

117944 

100792 

NIL 

>  (sysrquit) 

64. 5u  10.4s  20:05  6%  7344-t-19414]c  926-»-9io  797pf-f0w 

cm3 : •xitConnection  closed  by  foreign  host. 

ju> 

script  done  on  Wed  May  4  17:36:59  1988 
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